-- Logs begin at Tue 2022-10-18 10:53:56 UTC, end at Tue 2022-10-18 11:42:19 UTC. -- Oct 18 11:26:47.531893 dv-cinder-815582-17-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 18 11:26:47.542000 dv-cinder-815582-17-smb devstack@keystone.service[81691]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 18 11:26:47 2022] *** Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: nodename: dv-cinder-815582-17-smb Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: machine: x86_64 Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: clock source: unix Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: pcre jit disabled Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: detected number of CPU cores: 4 Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: current working directory: / Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: detected binary path: /usr/bin/uwsgi-core Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: your processes number limit is 47680 Oct 18 11:26:47.544109 dv-cinder-815582-17-smb devstack@keystone.service[81691]: your memory page size is 4096 bytes Oct 18 11:26:47.544778 dv-cinder-815582-17-smb devstack@keystone.service[81691]: detected max file descriptor number: 2048 Oct 18 11:26:47.544778 dv-cinder-815582-17-smb devstack@keystone.service[81691]: lock engine: pthread robust mutexes Oct 18 11:26:47.544778 dv-cinder-815582-17-smb devstack@keystone.service[81691]: thunder lock: enabled Oct 18 11:26:47.544778 dv-cinder-815582-17-smb devstack@keystone.service[81691]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 18 11:26:47.544778 dv-cinder-815582-17-smb devstack@keystone.service[81691]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 18 11:26:47.582461 dv-cinder-815582-17-smb devstack@keystone.service[81691]: Python main interpreter initialized at 0x563ba5cac9c0 Oct 18 11:26:47.582461 dv-cinder-815582-17-smb devstack@keystone.service[81691]: python threads support enabled Oct 18 11:26:47.582461 dv-cinder-815582-17-smb devstack@keystone.service[81691]: your server socket listen backlog is limited to 100 connections Oct 18 11:26:47.582461 dv-cinder-815582-17-smb devstack@keystone.service[81691]: your mercy for graceful operations on workers is 90 seconds Oct 18 11:26:47.582776 dv-cinder-815582-17-smb devstack@keystone.service[81691]: mapped 403077 bytes (393 KB) for 2 cores Oct 18 11:26:47.582866 dv-cinder-815582-17-smb devstack@keystone.service[81691]: *** Operational MODE: preforking *** Oct 18 11:26:47.583128 dv-cinder-815582-17-smb devstack@keystone.service[81691]: *** uWSGI is running in multiple interpreter mode *** Oct 18 11:26:47.583128 dv-cinder-815582-17-smb devstack@keystone.service[81691]: spawned uWSGI master process (pid: 81691) Oct 18 11:26:47.583333 dv-cinder-815582-17-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 18 11:26:47.585388 dv-cinder-815582-17-smb devstack@keystone.service[81691]: spawned uWSGI worker 1 (pid: 81702, cores: 1) Oct 18 11:26:47.585388 dv-cinder-815582-17-smb devstack@keystone.service[81691]: spawned uWSGI worker 2 (pid: 81703, cores: 1) Oct 18 11:26:47.585388 dv-cinder-815582-17-smb devstack@keystone.service[81691]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 18 11:26:51.890997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:26:51.890997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: from cryptography.utils import int_from_bytes Oct 18 11:26:51.891787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:26:51.891787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: from cryptography.utils import int_from_bytes Oct 18 11:26:51.892230 dv-cinder-815582-17-smb devstack@keystone.service[81702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:26:51.892230 dv-cinder-815582-17-smb devstack@keystone.service[81702]: from cryptography.utils import int_from_bytes Oct 18 11:26:51.892355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 18 11:26:51.892355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: from cryptography.utils import int_from_bytes Oct 18 11:26:51.941531 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 11:26:51.941725 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 11:26:51.941872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 18 11:26:51.941967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] command line args: [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 11:26:51.942048 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 18 11:26:51.942168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] command line args: [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 18 11:26:51.942255 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 11:26:51.942333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ================================================================================ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 11:26:51.942438 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 18 11:26:51.942588 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] admin_token = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.942673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ================================================================================ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 18 11:26:51.942835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] config_dir = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.942925 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] admin_token = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.943026 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.943755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] config_dir = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.943990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.944089 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] config_source = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.944259 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] debug = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.944345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] config_source = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.944538 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.944866 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] debug = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.944866 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945019 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945080 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945295 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945432 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945512 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945680 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.945910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946017 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_config_append = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_config_append = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946326 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946533 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_dir = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946633 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_dir = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946836 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.946941 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947281 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947401 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947526 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947875 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.947992 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.948113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.948113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.948342 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.948461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.948584 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.948584 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.948806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.948920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949033 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949146 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949259 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949727 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949965 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.949965 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.950180 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.950303 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.950420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.950534 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] publish_errors = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.950646 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.950769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.950883 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] publish_errors = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.950996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.951110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.951234 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.951380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.951494 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.951613 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.951748 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.951874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.951990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] standard_threads = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.952114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.952228 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.952348 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] standard_threads = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.952470 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.952592 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.952712 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.952833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.952947 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_journal = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.953066 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.953232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_json = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.953349 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_journal = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.953463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_stderr = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.953575 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_json = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.953694 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] use_syslog = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.953815 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_stderr = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.953940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.954056 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] use_syslog = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.954169 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.954282 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 18 11:26:51.954394 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.954496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.954619 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.954740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.954860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.954975 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.955093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.955208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.955352 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.955469 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.955582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.955701 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.955815 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.955935 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.956060 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.956181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.956301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.956415 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.956535 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.956649 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.956771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.956886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957218 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957330 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957695 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957815 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.957929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.958062 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.958186 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.958308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.958423 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.958543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.958658 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.958920 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959171 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959310 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959441 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959877 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.959997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.960219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.960333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.960333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.960559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.960673 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.960787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.960907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961028 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961272 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961398 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961863 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.961985 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.962100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.962214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.962327 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.962441 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.962562 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.962678 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.962792 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.962905 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.963019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.963138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.963309 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.963428 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.963542 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.963666 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.963782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.963782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.964003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.964118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.964231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.964346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.964458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.964578 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.964766 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.964890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965005 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965351 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965474 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965710 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965824 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.965937 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966290 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966632 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966751 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.966997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.967111 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.967230 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.967374 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.967473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.967578 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.967676 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.967771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.967900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968423 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968497 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968738 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.968970 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.969092 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.969208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.969314 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.969434 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.969560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.969692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.969809 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.969913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970140 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970259 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970503 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970609 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970721 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.970948 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.971075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.971197 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.971327 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.971443 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.971566 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.971683 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.971806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.971923 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972037 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972618 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972847 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.972961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.973337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.973464 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.973580 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.973700 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.973815 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.973929 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.974042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.974164 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.974280 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.974918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.975061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.975213 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.975361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.975490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.975608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.975723 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.975839 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.975953 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.976079 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.976203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.976319 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.976440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.976561 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.976677 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.976798 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.976992 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.977111 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.977226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.977341 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.977461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.977461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.977700 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.977825 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.977949 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978064 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978179 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978294 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978408 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978531 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978763 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978878 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.978993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.979108 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.979231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.979389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.979505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.979618 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.979732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.979859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.979988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.980105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.980219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.980332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.980446 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.external = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.980591 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.980716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.980832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.980956 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.981082 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.external = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.981199 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.981320 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.981443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.password = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.981443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] auth.token = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.981672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.981790 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.981905 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982020 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982137 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.password = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982252 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982379 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] auth.token = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982497 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982618 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.982973 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.983097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.983217 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.983380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.983499 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.983615 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.983731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.983859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.983976 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.984092 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.984207 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.984323 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.984440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.984563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.984681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.984796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.984912 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985142 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985265 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985383 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985498 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985614 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985730 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.985969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.986086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.986202 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.986353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.986469 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.986584 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.986709 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.986826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.986948 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.987076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.987192 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.987335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.987498 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.987618 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.987733 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.987848 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.987962 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.988076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.988199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.988315 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.988422 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.988534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.988649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.988772 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.988888 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989126 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989242 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989356 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989480 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989597 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989712 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989826 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.989988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.990640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.990772 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.990899 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.991016 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.991132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.991282 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.991460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.991667 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.991789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.991906 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992377 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992495 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992735 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992851 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.992967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.993091 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.993209 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.993325 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.993441 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.993557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.993674 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.993804 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.993923 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994039 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994039 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994255 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994371 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994494 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994612 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.994970 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.995086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.995210 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.995392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.995509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.995625 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.995741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.995858 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.995987 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.996105 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.996221 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.996337 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.996453 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.996569 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.996693 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.996812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.996927 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997158 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997398 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997515 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997848 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.997964 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.998088 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.998088 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.998306 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.998422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.998538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.998661 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.998779 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.998896 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999012 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999126 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999241 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999506 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999622 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:51.999970 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.000093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.000211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.000327 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.000442 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.000558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.000673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.000796 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.000914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001030 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001145 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001261 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001622 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001738 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001853 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.001968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.002085 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.002208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.002325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.002440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.002555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.002670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.002794 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.002918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.003035 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.003152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.003290 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.003409 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.003525 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.003656 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.003774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.003890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.004005 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.004120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.004237 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.004361 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.004756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.004871 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.004987 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.005102 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.005218 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.005342 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.005460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.005612 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.005734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.005875 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.006026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.006156 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.006275 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.006419 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.006581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.006700 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.006807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.006921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007037 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007406 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007522 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007650 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.007999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.008115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.008230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.008354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.008471 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.008576 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.008690 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.008806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.008921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009045 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009163 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009395 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009510 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009510 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009736 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.009854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.010070 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.010186 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.010301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.010409 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.010526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.010642 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.010757 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.010881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.011001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.011126 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.011243 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.011420 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.011537 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.011653 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.011768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.011897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012015 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012131 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012246 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012362 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.012949 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.013065 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.013180 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.013304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.013421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.013536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.013652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.013774 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.013898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.014016 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.014131 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.014246 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] role.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.014361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.014476 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] role.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.014665 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.014785 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.014901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015139 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015272 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015403 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015637 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] role.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.015984 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.016108 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] role.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.016225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.016341 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.016456 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.016572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.016687 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.016815 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.016933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017049 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017164 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017279 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017394 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017518 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017636 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017752 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017868 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.017983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.018425 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.018542 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.018648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.018763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.018879 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.018994 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.019118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.019235 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.019383 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.019499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.019614 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.019614 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.019843 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.019963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.020078 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.020194 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.020309 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.020432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.020550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.020665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.020780 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.020895 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.021011 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.021135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.021284 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.021405 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.021521 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.021635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.021756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.021883 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022000 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022457 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022697 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.022926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.023042 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.023156 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.023301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.023421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.023537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.023651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.023766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.023881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024004 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024468 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024705 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024822 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.024937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025052 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025283 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025869 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.025869 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.026092 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.026210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.026333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.026458 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.026575 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.026689 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.026803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.026926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.027043 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.027159 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.027334 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.027453 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.027568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.027696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.027813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.027929 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028168 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028295 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028527 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028651 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028882 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.028996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.029110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.029225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.029353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.029470 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.029586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.029701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.029815 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.029931 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030054 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030171 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030402 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030632 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030756 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.030988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031102 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031217 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031351 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031482 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 11:26:52.031601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 18 11:26:52.031601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 18 11:26:52.057216 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.057440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.057661 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.058141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.058355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.058575 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.065912 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.066779 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.094012 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.094184 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.094797 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.095026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.149004 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.149673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.197394 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.197620 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.198814 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.199045 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.353869 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.354041 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.354216 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.354430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.354641 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.354851 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.355388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.355620 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.355840 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.356056 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.356270 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.356480 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.377524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.377739 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.377827 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.377953 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378051 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378165 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378248 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378456 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378782 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.378988 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.390197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.390615 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.403370 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.403597 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.403796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.403897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404010 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404092 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404426 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81702) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.404844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.405052 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81703) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 18 11:26:52.421987 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.422193 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 11:26:52.422276 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.422441 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 11:26:52.422524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.422713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 11:26:52.422813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.422960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 18 11:26:52.423043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.423223 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.423325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.423505 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.423590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.423756 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.423837 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.424006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.433299 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.433570 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.433815 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.433898 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.434090 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.434174 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.434357 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.434640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.441055 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.441532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.444157 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.444440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.444700 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.444783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.444982 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.445064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.445259 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.445347 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.445515 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.445597 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.445782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.445865 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.446047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.446131 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.446308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.446390 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.446573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.446663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.446836 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.446918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.447103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.447390 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.469944 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.470777 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.471412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.471692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.472252 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.472533 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.476924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.477204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.477480 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.478256 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.478349 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.478599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.483778 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.484059 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.484879 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.485158 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.489619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.489914 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.490223 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.490504 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.490779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.490942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.491037 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.491238 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.491352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.491546 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.491629 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.491830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.492106 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.492382 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.492655 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.492922 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.507081 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.507382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.509002 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.509277 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.511132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.513071 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.514316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.514609 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.516239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.516532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.518753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.520744 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.522357 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.524684 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.525536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.525833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.526114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.526395 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.526667 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.526940 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.527848 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.528143 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.528420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.528697 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.528969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.529243 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.542481 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.542760 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.543024 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.543304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.544915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.545200 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.545463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.545732 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.550090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.551632 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.553132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.553729 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.554003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.554961 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.556515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.556667 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.556787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.556949 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.557227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.557505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.557898 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.559551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.559839 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.560116 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.560393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.560782 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.569073 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.569351 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.569627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.569905 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.570279 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.570564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.570838 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.572172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.572454 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.572731 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.573020 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.573396 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.573671 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.573952 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.586580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.589484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.590191 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.592346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.593105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.593787 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.595236 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.595536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.595942 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.596025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.597391 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.598947 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.599225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.599836 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.602487 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.604013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.606495 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.606815 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.607208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.607537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.607800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.607978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.610824 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.611217 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.611524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.611797 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.616730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.617015 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.617293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.620351 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.620636 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.620909 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.624154 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81702) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.624437 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.624715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.624985 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.625261 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.625528 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.625795 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.626065 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.626327 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.626596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.626870 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.627146 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.627429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.627695 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81702) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.627786 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81703) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 18 11:26:52.628002 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.628278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.628550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.628821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.629098 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.629364 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.629893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.630157 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.630445 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.631288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.631760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.632102 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.632371 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81703) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 18 11:26:52.662086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563ba5cac9c0 pid: 81702 (default app) Oct 18 11:26:52.665347 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873270-dc06-4460-89ee-613189c0b4d8 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:26:52.665629 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873270-dc06-4460-89ee-613189c0b4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:26:52.665896 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89873270-dc06-4460-89ee-613189c0b4d8 None None] PATH_INFO: `/v3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:26:52.666814 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563ba5cac9c0 pid: 81703 (default app) Oct 18 11:26:52.669995 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Oct 18 11:26:52 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:26:59.524999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d6aa-6b98-4ac7-9719-494958533085 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:26:59.525517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d6aa-6b98-4ac7-9719-494958533085 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:26:59.525517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d6aa-6b98-4ac7-9719-494958533085 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:26:59.529777 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:26:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:26:59.535313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:26:59.535903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:26:59.535903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:26:59.606365 dv-cinder-815582-17-smb devstack@keystone.service[81702]: INFO dbcounter [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] Registered counter for database keystone Oct 18 11:26:59.625618 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG oslo_db.sqlalchemy.engines [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:26:59.632158 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writer thread running {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:26:59.810758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG passlib.handlers.bcrypt [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81702) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 18 11:26:59.811066 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG passlib.handlers.bcrypt [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81702) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 18 11:26:59.869632 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:26:59.871234 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:26:59.999156 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:26:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 18 11:27:00.492533 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d6aa-6b98-4ac7-9719-494958533085 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:00.563234 dv-cinder-815582-17-smb devstack@keystone.service[81703]: INFO dbcounter [None req-a9b1d6aa-6b98-4ac7-9719-494958533085 None None] Registered counter for database keystone Oct 18 11:27:00.585021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b1d6aa-6b98-4ac7-9719-494958533085 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 18 11:27:00.591381 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writer thread running {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 18 11:27:00.708350 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d6aa-6b98-4ac7-9719-494958533085 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:00.712795 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04b016-e155-4342-8820-5c7f7017f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:00.713418 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b016-e155-4342-8820-5c7f7017f45d admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:00.713698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b016-e155-4342-8820-5c7f7017f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:00.713968 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04b016-e155-4342-8820-5c7f7017f45d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:00.722068 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04b016-e155-4342-8820-5c7f7017f45d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:00.774925 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eb04b016-e155-4342-8820-5c7f7017f45d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 18 11:27:00.775205 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04b016-e155-4342-8820-5c7f7017f45d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:00.784442 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 18 11:27:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 18 11:27:00.790467 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:00.807917 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83a60b-2448-4ddd-a11a-92386e0baa5f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:00.812643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a97e-dbd9-4ba5-a2f2-66d75b754e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:00.813745 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a97e-dbd9-4ba5-a2f2-66d75b754e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:00.814023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a97e-dbd9-4ba5-a2f2-66d75b754e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:00.814295 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a97e-dbd9-4ba5-a2f2-66d75b754e73 admin admin] PATH_INFO: `/v3/projects/cdaa8f68f2eb45d98feb8999be80016c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:00.815964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a97e-dbd9-4ba5-a2f2-66d75b754e73 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdaa8f68f2eb45d98feb8999be80016c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:00.870283 dv-cinder-815582-17-smb devstack@keystone.service[81702]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a782a97e-dbd9-4ba5-a2f2-66d75b754e73 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 18 11:27:00.870631 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a97e-dbd9-4ba5-a2f2-66d75b754e73 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:00.875188 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 18 11:27:00 2022] GET /identity/v3/projects/cdaa8f68f2eb45d98feb8999be80016c => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:03.014635 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227218-7ae6-4e95-83c4-c94f44697234 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:03.015138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227218-7ae6-4e95-83c4-c94f44697234 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:03.015221 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227218-7ae6-4e95-83c4-c94f44697234 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:03.019246 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:03.024729 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bda79-899b-4cf4-92ca-220d0926acf2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:03.025133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bda79-899b-4cf4-92ca-220d0926acf2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:03.025282 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bda79-899b-4cf4-92ca-220d0926acf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:03.045000 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-693bda79-899b-4cf4-92ca-220d0926acf2 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:03.046494 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-693bda79-899b-4cf4-92ca-220d0926acf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:03.054882 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 11:27:03.319699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227218-7ae6-4e95-83c4-c94f44697234 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:03.331859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227218-7ae6-4e95-83c4-c94f44697234 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:03.336784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ab4af-3a30-41df-ac92-3f50d45a731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:03.337376 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ab4af-3a30-41df-ac92-3f50d45a731e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:03.337657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ab4af-3a30-41df-ac92-3f50d45a731e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:03.337927 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ab4af-3a30-41df-ac92-3f50d45a731e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:03.345452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ab4af-3a30-41df-ac92-3f50d45a731e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:03.347192 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ab4af-3a30-41df-ac92-3f50d45a731e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:03.355863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Oct 18 11:27:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 11:27:03.361047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bda79-899b-4cf4-92ca-220d0926acf2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:03.370030 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bda79-899b-4cf4-92ca-220d0926acf2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:03.375754 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f880bf-8361-4aaa-bbda-44ab5d56abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:03.376487 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f880bf-8361-4aaa-bbda-44ab5d56abef admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:03.376774 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f880bf-8361-4aaa-bbda-44ab5d56abef admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:03.377195 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f880bf-8361-4aaa-bbda-44ab5d56abef admin admin] PATH_INFO: `/v3/users/abc5671b261f45af8270d5381600d177` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:03.378516 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f880bf-8361-4aaa-bbda-44ab5d56abef admin admin] RBAC: Authorizing `identity:get_user(user_id=abc5671b261f45af8270d5381600d177)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:03.381144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f880bf-8361-4aaa-bbda-44ab5d56abef admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:03.382824 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Oct 18 11:27:03 2022] GET /identity/v3/users/abc5671b261f45af8270d5381600d177 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:05.584587 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e1135-f656-4259-8ae8-763c7165b0be None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:05.585141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e1135-f656-4259-8ae8-763c7165b0be None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:05.585141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e1135-f656-4259-8ae8-763c7165b0be None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:05.586436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:05.591715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d40ba-91f2-4323-82aa-09feea759cec None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:05.592142 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d40ba-91f2-4323-82aa-09feea759cec None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:05.592398 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d40ba-91f2-4323-82aa-09feea759cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:05.610699 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a79d40ba-91f2-4323-82aa-09feea759cec None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:05.611932 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a79d40ba-91f2-4323-82aa-09feea759cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:05.650297 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a0ede-0c4c-446d-b1d0-b115c50e086e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:05.650574 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a0ede-0c4c-446d-b1d0-b115c50e086e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:05.650854 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a0ede-0c4c-446d-b1d0-b115c50e086e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:05.652184 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:27:05.657131 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:05.657411 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:05.657685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:05.693929 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:05.701346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG passlib.handlers.bcrypt [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81703) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 18 11:27:05.701722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG passlib.handlers.bcrypt [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81703) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 18 11:27:05.751350 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:05.752905 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:05.853568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:05.968749 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d40ba-91f2-4323-82aa-09feea759cec None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:05.994386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:06.072924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d40ba-91f2-4323-82aa-09feea759cec None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:06.105803 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876130c-31e6-4cd5-979a-e69b1edfc415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:06.106503 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876130c-31e6-4cd5-979a-e69b1edfc415 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:06.106784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876130c-31e6-4cd5-979a-e69b1edfc415 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:06.107054 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876130c-31e6-4cd5-979a-e69b1edfc415 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:06.117827 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876130c-31e6-4cd5-979a-e69b1edfc415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:06.122008 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c876130c-31e6-4cd5-979a-e69b1edfc415 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:06.126553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:06.127574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:06.128400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:06.133744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876130c-31e6-4cd5-979a-e69b1edfc415 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:06.214332 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:06.223481 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27143d8-7da5-49b1-b0ff-43791fc3a99b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:06.226922 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:06.233108 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876130c-31e6-4cd5-979a-e69b1edfc415 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:06.261935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:06.262796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:06.263086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:06.263388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:06.264369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:06.265794 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:06.267628 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:06.268225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:06.268497 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:06.268762 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:06.269422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:06.269719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:06.271837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:06.277417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.sql.core [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 11:27:06.277417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 11:27:06.277417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [parameters: {'id': 'da0c95cf6b0845c099ce9e7e61dc75a6', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 11:27:06.277417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81703) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 11:27:06.284281 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:06.289853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:27:06.296170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result.read() Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 11:27:06.297150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application yield resource Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise self.value Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application session.commit() Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 11:27:06.298063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.session.flush() Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application compat.raise_( Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 11:27:06.298956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 11:27:06.299898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result.read() Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:27:06.300673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [parameters: {'id': 'da0c95cf6b0845c099ce9e7e61dc75a6', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 11:27:06.301493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:06.302465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 8/16] 10.222.0.18 () {60 vars in 1137 bytes} [Tue Oct 18 11:27:06 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:06.303644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:06.392861 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2a78a-d107-48c7-9ef2-bd4ceda74d8a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:06.403705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925c6b0-0d33-4071-927c-b0dfaacbf243 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:06.425895 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ca73-0163-4e8e-a81c-be853cc49376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:06.426515 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ca73-0163-4e8e-a81c-be853cc49376 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:06.426790 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ca73-0163-4e8e-a81c-be853cc49376 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:06.427062 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8ca73-0163-4e8e-a81c-be853cc49376 None admin] PATH_INFO: `/v3/users/abc5671b261f45af8270d5381600d177` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:06.428304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8ca73-0163-4e8e-a81c-be853cc49376 None admin] RBAC: Authorizing `identity:get_user(user_id=abc5671b261f45af8270d5381600d177)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:06.429757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8ca73-0163-4e8e-a81c-be853cc49376 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:06.431509 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:06 2022] GET /identity/v3/users/abc5671b261f45af8270d5381600d177 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:06.436411 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:06.436845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ca73-0163-4e8e-a81c-be853cc49376 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:06.437257 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:06.437537 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:06.437812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:06.453283 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:06.456389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:06.457862 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:27:06.475965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:06.476835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:27:06.477677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:27:06.477677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:27:06.477677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:06.477677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:06.482999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:06.506303 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:06.541269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8ca73-0163-4e8e-a81c-be853cc49376 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:06.576025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d537da-5c44-4adb-94dc-fb715e8fef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:06.576764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d537da-5c44-4adb-94dc-fb715e8fef22 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:06.577050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d537da-5c44-4adb-94dc-fb715e8fef22 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:06.577325 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d537da-5c44-4adb-94dc-fb715e8fef22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:06.578447 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d537da-5c44-4adb-94dc-fb715e8fef22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:06.579954 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d537da-5c44-4adb-94dc-fb715e8fef22 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:06.581507 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:06.587448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d537da-5c44-4adb-94dc-fb715e8fef22 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:06.587957 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fe30a-aa92-4223-8f1e-4cd97339e8b8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:06.622253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f036c4-0c09-44d3-8b7a-65d6ae3225ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:06.622857 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f036c4-0c09-44d3-8b7a-65d6ae3225ae None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:06.623131 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f036c4-0c09-44d3-8b7a-65d6ae3225ae None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:06.623444 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f036c4-0c09-44d3-8b7a-65d6ae3225ae None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:06.624075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f036c4-0c09-44d3-8b7a-65d6ae3225ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:06.624374 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f036c4-0c09-44d3-8b7a-65d6ae3225ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:06.625747 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f036c4-0c09-44d3-8b7a-65d6ae3225ae None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:06.643838 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:06.669735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:06.691312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d537da-5c44-4adb-94dc-fb715e8fef22 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:06.728277 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5d716-4795-4052-9096-b96f04997585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:06.729043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5d716-4795-4052-9096-b96f04997585 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:06.729232 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5d716-4795-4052-9096-b96f04997585 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:06.729506 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5d716-4795-4052-9096-b96f04997585 None admin] PATH_INFO: `/v3/domains/default/users/abc5671b261f45af8270d5381600d177/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:06.731487 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5d716-4795-4052-9096-b96f04997585 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=abc5671b261f45af8270d5381600d177, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:06.732968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5d716-4795-4052-9096-b96f04997585 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:06.853172 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Oct 18 11:27:06 2022] PUT /identity/v3/domains/default/users/abc5671b261f45af8270d5381600d177/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:27:09.256215 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a287-611f-4640-8a2f-daf327f25b84 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.256750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a287-611f-4640-8a2f-daf327f25b84 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.256750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a287-611f-4640-8a2f-daf327f25b84 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.258244 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:09.263888 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df7c2-9b03-4474-9daf-ef00bd36271b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.264729 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df7c2-9b03-4474-9daf-ef00bd36271b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.265198 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df7c2-9b03-4474-9daf-ef00bd36271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.292385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-266df7c2-9b03-4474-9daf-ef00bd36271b None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:09.294243 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-266df7c2-9b03-4474-9daf-ef00bd36271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:09.390807 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:09.411596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92984-ed6f-4a6b-b0c0-3b11ddad65ef None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.412728 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92984-ed6f-4a6b-b0c0-3b11ddad65ef None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.413200 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92984-ed6f-4a6b-b0c0-3b11ddad65ef None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.414720 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:09.420248 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c3a2-7f94-4f53-89b8-f730dbe87496 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.420775 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c3a2-7f94-4f53-89b8-f730dbe87496 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.421249 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c3a2-7f94-4f53-89b8-f730dbe87496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.452313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8076c3a2-7f94-4f53-89b8-f730dbe87496 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:09.453833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8076c3a2-7f94-4f53-89b8-f730dbe87496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:09.535285 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:09.541623 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:09.563906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbc147-8809-445a-9899-deb75982ee13 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.564516 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbc147-8809-445a-9899-deb75982ee13 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.565004 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbc147-8809-445a-9899-deb75982ee13 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.566516 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:09.579440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a829e2-09fb-4408-8c1b-a9f96d7da4e5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.579998 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a829e2-09fb-4408-8c1b-a9f96d7da4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.580491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a829e2-09fb-4408-8c1b-a9f96d7da4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.599610 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-94a829e2-09fb-4408-8c1b-a9f96d7da4e5 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:09.601086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94a829e2-09fb-4408-8c1b-a9f96d7da4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:09.681536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:09.704877 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbc147-8809-445a-9899-deb75982ee13 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:09.811537 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:09.832977 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbc147-8809-445a-9899-deb75982ee13 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:09.870967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60826ed-d499-49b3-8120-e1cce9a2bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:09.871647 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60826ed-d499-49b3-8120-e1cce9a2bf01 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.871929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60826ed-d499-49b3-8120-e1cce9a2bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.872202 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60826ed-d499-49b3-8120-e1cce9a2bf01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.885829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60826ed-d499-49b3-8120-e1cce9a2bf01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d60826ed-d499-49b3-8120-e1cce9a2bf01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:09.892557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:09.893425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:09.894214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 14/28] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:09.900185 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104351-571d-4213-bb1c-7b4e69725d7d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.900496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104351-571d-4213-bb1c-7b4e69725d7d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.900749 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104351-571d-4213-bb1c-7b4e69725d7d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.905063 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 15/29] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:09.907923 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60826ed-d499-49b3-8120-e1cce9a2bf01 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:09.911060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407f5c-bcb1-4af7-8abf-673b5810cc81 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:09.911371 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407f5c-bcb1-4af7-8abf-673b5810cc81 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:09.911647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407f5c-bcb1-4af7-8abf-673b5810cc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:09.942826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2c407f5c-bcb1-4af7-8abf-673b5810cc81 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:09.944635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2c407f5c-bcb1-4af7-8abf-673b5810cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:10.070783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 16/30] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:10.075703 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c407f5c-bcb1-4af7-8abf-673b5810cc81 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:10.118124 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60826ed-d499-49b3-8120-e1cce9a2bf01 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:10.159278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:10.159278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:10.159278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:10.159278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:10.159672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:10.159672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:10.160166 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:10.184409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:10.190963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:10.196935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:10.206145 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:10.253854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c407f5c-bcb1-4af7-8abf-673b5810cc81 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:10.353733 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc6e8d-edea-42cf-bfb8-9f03d953a204 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:10.359969 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:10.360619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:10.360902 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:10.361180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:10.378731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:10.382476 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:27:10.412757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:10.413658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:27:10.414459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:27:10.414459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:27:10.414459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:10.415039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0297e5-660e-4c0d-9abd-50c95815a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:10.415526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0297e5-660e-4c0d-9abd-50c95815a687 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:10.415807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0297e5-660e-4c0d-9abd-50c95815a687 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:10.416078 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0297e5-660e-4c0d-9abd-50c95815a687 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:10.416747 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0297e5-660e-4c0d-9abd-50c95815a687 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:10.418116 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0297e5-660e-4c0d-9abd-50c95815a687 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:10.419961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 17/32] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:10.420887 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:10.533688 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176b8e8-c119-4327-b9f0-b24a457e801d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:10.549555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 16/33] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 18 11:27:10 2022] POST /identity/v3/roles => generated 225 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:10.550766 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0297e5-660e-4c0d-9abd-50c95815a687 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:10.562067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:10.574765 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba11ac5-af79-41ac-9055-cd3787484223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:10.575809 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba11ac5-af79-41ac-9055-cd3787484223 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:10.576239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba11ac5-af79-41ac-9055-cd3787484223 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:10.576661 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba11ac5-af79-41ac-9055-cd3787484223 None admin] PATH_INFO: `/v3/users/abc5671b261f45af8270d5381600d177` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:10.578181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba11ac5-af79-41ac-9055-cd3787484223 None admin] RBAC: Authorizing `identity:get_user(user_id=abc5671b261f45af8270d5381600d177)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:10.579993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba11ac5-af79-41ac-9055-cd3787484223 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:10.581960 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 18/34] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:10 2022] GET /identity/v3/users/abc5671b261f45af8270d5381600d177 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:10.583068 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba11ac5-af79-41ac-9055-cd3787484223 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:10.631117 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:10.715140 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0297e5-660e-4c0d-9abd-50c95815a687 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:10.773473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba11ac5-af79-41ac-9055-cd3787484223 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:10.787474 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7f933-685d-4213-b13b-f853711e3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:10.788112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7f933-685d-4213-b13b-f853711e3ae8 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:10.788551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7f933-685d-4213-b13b-f853711e3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:10.788753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7f933-685d-4213-b13b-f853711e3ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:10.789430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7f933-685d-4213-b13b-f853711e3ae8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:10.790947 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7f933-685d-4213-b13b-f853711e3ae8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:10.817250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 17/35] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 18 11:27:10 2022] POST /identity/v3/roles => generated 219 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:10.818244 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7f933-685d-4213-b13b-f853711e3ae8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:10.830524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3645deb-de68-4a18-b3b5-7638ee65771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:10.832272 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645deb-de68-4a18-b3b5-7638ee65771f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:10.832555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645deb-de68-4a18-b3b5-7638ee65771f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:10.832832 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3645deb-de68-4a18-b3b5-7638ee65771f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:10.834500 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3645deb-de68-4a18-b3b5-7638ee65771f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:10.834872 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3645deb-de68-4a18-b3b5-7638ee65771f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:10.839219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3645deb-de68-4a18-b3b5-7638ee65771f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:10.982002 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 19/36] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:10.983400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e11d-645c-4ceb-aef4-573c5a515b8a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:10.983695 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e11d-645c-4ceb-aef4-573c5a515b8a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:10.983981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e11d-645c-4ceb-aef4-573c5a515b8a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:10.985231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 20/37] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:10.988660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e11d-645c-4ceb-aef4-573c5a515b8a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:10.998186 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7f933-685d-4213-b13b-f853711e3ae8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:11.032224 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:11.049982 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebfa7e-a166-48ad-a487-f3eeb5a16130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:11.051346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebfa7e-a166-48ad-a487-f3eeb5a16130 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:11.052002 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebfa7e-a166-48ad-a487-f3eeb5a16130 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:11.052299 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebfa7e-a166-48ad-a487-f3eeb5a16130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:11.054574 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebfa7e-a166-48ad-a487-f3eeb5a16130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:11.056364 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebfa7e-a166-48ad-a487-f3eeb5a16130 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:11.058303 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 18/38] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:11.058737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:11.059580 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa53e-8261-4afd-a02e-4e94713d3d20 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:11.059989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa53e-8261-4afd-a02e-4e94713d3d20 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:11.060273 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfa53e-8261-4afd-a02e-4e94713d3d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:11.083555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-97cfa53e-8261-4afd-a02e-4e94713d3d20 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:11.085399 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-97cfa53e-8261-4afd-a02e-4e94713d3d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:11.130344 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e11d-645c-4ceb-aef4-573c5a515b8a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:11.169427 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 19/39] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:11.170393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfa53e-8261-4afd-a02e-4e94713d3d20 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:11.183475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93431607-46b6-4f04-bb87-7b2b9c0aed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:11.184465 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93431607-46b6-4f04-bb87-7b2b9c0aed04 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:11.185005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93431607-46b6-4f04-bb87-7b2b9c0aed04 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:11.185645 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93431607-46b6-4f04-bb87-7b2b9c0aed04 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:11.186476 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93431607-46b6-4f04-bb87-7b2b9c0aed04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:11.188304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93431607-46b6-4f04-bb87-7b2b9c0aed04 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:11.225721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:27:10 2022] POST /identity/v3/projects => generated 301 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:27:11.284770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfa53e-8261-4afd-a02e-4e94713d3d20 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:11.312030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:11.329921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e11da-f155-4068-b37c-21b0299f4d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:11.330883 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e11da-f155-4068-b37c-21b0299f4d44 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:11.331395 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e11da-f155-4068-b37c-21b0299f4d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:11.331845 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e11da-f155-4068-b37c-21b0299f4d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:11.332829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e11da-f155-4068-b37c-21b0299f4d44 None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.domain.id=default, user.id=abc5671b261f45af8270d5381600d177) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:11.333314 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e11da-f155-4068-b37c-21b0299f4d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:11.335086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e11da-f155-4068-b37c-21b0299f4d44 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:11.349643 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 20/41] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Oct 18 11:27:11 2022] GET /identity/v3/role_assignments?user.id=abc5671b261f45af8270d5381600d177&scope.domain.id=default&role.id=78ddf427bf274205867c7492aec1f590 => generated 530 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:11.416660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb60d50-f7f9-4bf2-8186-481e0e2bf0e1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:11.417170 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb60d50-f7f9-4bf2-8186-481e0e2bf0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:11.417241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb60d50-f7f9-4bf2-8186-481e0e2bf0e1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:11.418613 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 22/42] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:11.424567 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c9fe-5db3-4bf5-bcc8-6016bb58a618 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:11.425050 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c9fe-5db3-4bf5-bcc8-6016bb58a618 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:11.425121 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c9fe-5db3-4bf5-bcc8-6016bb58a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:11.446499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4bf8c9fe-5db3-4bf5-bcc8-6016bb58a618 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:11.447822 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4bf8c9fe-5db3-4bf5-bcc8-6016bb58a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:11.500506 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb60d50-f7f9-4bf2-8186-481e0e2bf0e1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:11.530863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:11.602505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:11.613231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb60d50-f7f9-4bf2-8186-481e0e2bf0e1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:11.647516 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66a1a-cd9b-45e2-b433-1cc47e262692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:11.648119 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66a1a-cd9b-45e2-b433-1cc47e262692 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:11.648401 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66a1a-cd9b-45e2-b433-1cc47e262692 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:11.648674 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66a1a-cd9b-45e2-b433-1cc47e262692 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:11.649346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66a1a-cd9b-45e2-b433-1cc47e262692 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:11.650717 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66a1a-cd9b-45e2-b433-1cc47e262692 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:11.665737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 18 11:27:11 2022] POST /identity/v3/roles => generated 223 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:27:11.796407 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8c9fe-5db3-4bf5-bcc8-6016bb58a618 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:11.899643 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8c9fe-5db3-4bf5-bcc8-6016bb58a618 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:11.913409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:11.933964 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd0158-b116-4a07-95f3-a8922a1e1043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:11.934591 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0158-b116-4a07-95f3-a8922a1e1043 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:11.934872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0158-b116-4a07-95f3-a8922a1e1043 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:11.935148 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0158-b116-4a07-95f3-a8922a1e1043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:11.936278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd0158-b116-4a07-95f3-a8922a1e1043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:11.937740 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd0158-b116-4a07-95f3-a8922a1e1043 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:11.939316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 22/45] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:11.946812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66a1a-cd9b-45e2-b433-1cc47e262692 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:12.043872 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66a1a-cd9b-45e2-b433-1cc47e262692 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:12.076864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847132c8-c908-4232-932e-346eee64324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:12.077461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847132c8-c908-4232-932e-346eee64324b None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:12.077741 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847132c8-c908-4232-932e-346eee64324b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:12.078011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847132c8-c908-4232-932e-346eee64324b None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:12.078649 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847132c8-c908-4232-932e-346eee64324b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:12.080119 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847132c8-c908-4232-932e-346eee64324b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:12.105228 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:27:11 2022] POST /identity/v3/projects => generated 312 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:14.218698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d668b6-5fdf-4e87-9627-b504d1779db1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:14.219238 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d668b6-5fdf-4e87-9627-b504d1779db1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:14.219238 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d668b6-5fdf-4e87-9627-b504d1779db1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:14.220598 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:14.226046 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467ddf0-38a9-4ea5-b64a-306e1a5476f1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:14.226459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467ddf0-38a9-4ea5-b64a-306e1a5476f1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:14.226598 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467ddf0-38a9-4ea5-b64a-306e1a5476f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:14.233845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:14.245682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a467ddf0-38a9-4ea5-b64a-306e1a5476f1 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:14.246882 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a467ddf0-38a9-4ea5-b64a-306e1a5476f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:14.311767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:14.584437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d668b6-5fdf-4e87-9627-b504d1779db1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:14.684395 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d668b6-5fdf-4e87-9627-b504d1779db1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:14.717186 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee59f1-1730-4b72-87ca-11c884666142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:14.717803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee59f1-1730-4b72-87ca-11c884666142 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:14.718087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee59f1-1730-4b72-87ca-11c884666142 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:14.718365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee59f1-1730-4b72-87ca-11c884666142 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:14.719502 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee59f1-1730-4b72-87ca-11c884666142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:14.720934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee59f1-1730-4b72-87ca-11c884666142 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:14.722465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:14.728848 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467ddf0-38a9-4ea5-b64a-306e1a5476f1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:14.824725 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467ddf0-38a9-4ea5-b64a-306e1a5476f1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:14.858681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd56a2-4502-467e-be8e-d85cea288f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:14.859307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd56a2-4502-467e-be8e-d85cea288f85 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:14.859587 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd56a2-4502-467e-be8e-d85cea288f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:14.859856 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd56a2-4502-467e-be8e-d85cea288f85 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:14.860492 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd56a2-4502-467e-be8e-d85cea288f85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:14.861926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd56a2-4502-467e-be8e-d85cea288f85 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:14.866484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:14.887656 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Oct 18 11:27:14 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:17.017639 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042535f-f5af-48bd-bb44-64902df5b2ba None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:17.018149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042535f-f5af-48bd-bb44-64902df5b2ba None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:17.018261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042535f-f5af-48bd-bb44-64902df5b2ba None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:17.019559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 25/51] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:17.024660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1519d-9995-452b-9c2f-931b03897f86 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:17.025034 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1519d-9995-452b-9c2f-931b03897f86 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:17.025200 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1519d-9995-452b-9c2f-931b03897f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:17.043543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-87b1519d-9995-452b-9c2f-931b03897f86 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:17.044705 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-87b1519d-9995-452b-9c2f-931b03897f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:17.108660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 27/52] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:17.375307 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042535f-f5af-48bd-bb44-64902df5b2ba None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:17.425735 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:17.475970 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042535f-f5af-48bd-bb44-64902df5b2ba None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:17.509605 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945ab8c-237f-4592-9540-1cb04abf0e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:17.510222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ab8c-237f-4592-9540-1cb04abf0e37 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:17.510504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ab8c-237f-4592-9540-1cb04abf0e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:17.510778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ab8c-237f-4592-9540-1cb04abf0e37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:17.511902 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945ab8c-237f-4592-9540-1cb04abf0e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:17.513335 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945ab8c-237f-4592-9540-1cb04abf0e37 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:17.514871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:17.520486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1519d-9995-452b-9c2f-931b03897f86 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:17.616371 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1519d-9995-452b-9c2f-931b03897f86 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:17.632704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:17.651023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30709f1-5089-4627-9a27-2fe9728ec47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:17.651648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30709f1-5089-4627-9a27-2fe9728ec47e None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:17.651926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30709f1-5089-4627-9a27-2fe9728ec47e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:17.652197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30709f1-5089-4627-9a27-2fe9728ec47e None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:17.652845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30709f1-5089-4627-9a27-2fe9728ec47e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:17.654278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30709f1-5089-4627-9a27-2fe9728ec47e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:17.680928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 28/54] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:27:17 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:20.887165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a4933-a092-4692-8e93-de2f2c20883b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:20.888154 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a4933-a092-4692-8e93-de2f2c20883b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:20.888657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a4933-a092-4692-8e93-de2f2c20883b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:20.890191 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 27/55] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:20.895843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e100e9-d762-4eb3-95ff-b72f34580b77 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:20.897265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e100e9-d762-4eb3-95ff-b72f34580b77 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:20.897913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e100e9-d762-4eb3-95ff-b72f34580b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:20.917363 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-43e100e9-d762-4eb3-95ff-b72f34580b77 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:20.918865 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-43e100e9-d762-4eb3-95ff-b72f34580b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:21.024385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 29/56] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:21.091097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053a196-835b-4f8b-8d31-2f1237f370b6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.091708 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053a196-835b-4f8b-8d31-2f1237f370b6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.092191 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053a196-835b-4f8b-8d31-2f1237f370b6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.093716 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 28/57] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:21.099006 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955767b-9926-438a-81a8-41b3f63306ea None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.100092 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955767b-9926-438a-81a8-41b3f63306ea None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.100762 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955767b-9926-438a-81a8-41b3f63306ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.123863 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b955767b-9926-438a-81a8-41b3f63306ea None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:21.125358 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b955767b-9926-438a-81a8-41b3f63306ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:21.220281 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 30/58] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:21.303913 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9187-c916-420f-a96c-c0082e1774ed None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.304554 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9187-c916-420f-a96c-c0082e1774ed None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.305016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c9187-c916-420f-a96c-c0082e1774ed None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.306543 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 29/59] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:21.311883 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d7dc1-0a19-40d5-a443-cf64a611b804 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.312171 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d7dc1-0a19-40d5-a443-cf64a611b804 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.312446 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d7dc1-0a19-40d5-a443-cf64a611b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.336270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9a8d7dc1-0a19-40d5-a443-cf64a611b804 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:21.337455 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9a8d7dc1-0a19-40d5-a443-cf64a611b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:21.375098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:21.375306 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c9187-c916-420f-a96c-c0082e1774ed None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:21.470002 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 31/60] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:21.563349 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c211d8-4ff4-4b50-bd42-a5c3e8a2c4e7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.563977 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c211d8-4ff4-4b50-bd42-a5c3e8a2c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.564446 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c211d8-4ff4-4b50-bd42-a5c3e8a2c4e7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.565990 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 32/61] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:27:21.571337 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d185f-084c-4d61-b460-58030f87f29b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.571879 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d185f-084c-4d61-b460-58030f87f29b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.572344 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d185f-084c-4d61-b460-58030f87f29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.610073 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-846d185f-084c-4d61-b460-58030f87f29b None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:21.611388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-846d185f-084c-4d61-b460-58030f87f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:21.669719 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c9187-c916-420f-a96c-c0082e1774ed None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:21.689113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:21.717578 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9d631-9b43-43cb-8f13-9a5044afb7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:21.718209 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9d631-9b43-43cb-8f13-9a5044afb7bd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.718485 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9d631-9b43-43cb-8f13-9a5044afb7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.718754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9d631-9b43-43cb-8f13-9a5044afb7bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.726588 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 33/62] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:21.727642 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d185f-084c-4d61-b460-58030f87f29b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:21.736136 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9d631-9b43-43cb-8f13-9a5044afb7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-83b9d631-9b43-43cb-8f13-9a5044afb7bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:21.743903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:21.744738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:21.745491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:21.748582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 30/63] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:21.751109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe0ea-4fb7-420f-833a-282b37f67e85 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.751617 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe0ea-4fb7-420f-833a-282b37f67e85 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.752080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fe0ea-4fb7-420f-833a-282b37f67e85 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.754444 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 31/64] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:21.756259 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe0ea-4fb7-420f-833a-282b37f67e85 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:21.828027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:21.838591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d185f-084c-4d61-b460-58030f87f29b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:21.873840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bede8-baf8-4556-bdca-a8fe7a086e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:21.874471 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bede8-baf8-4556-bdca-a8fe7a086e20 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.874774 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bede8-baf8-4556-bdca-a8fe7a086e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.875020 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bede8-baf8-4556-bdca-a8fe7a086e20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.886271 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fe0ea-4fb7-420f-833a-282b37f67e85 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:21.886499 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bede8-baf8-4556-bdca-a8fe7a086e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1a1bede8-baf8-4556-bdca-a8fe7a086e20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:21.891280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:21.892094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:21.893359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 34/65] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:27:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:21.894213 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11dd4-7b29-4d42-9784-2e0933af4be4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.894280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11dd4-7b29-4d42-9784-2e0933af4be4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.894909 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11dd4-7b29-4d42-9784-2e0933af4be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.915080 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c9b11dd4-7b29-4d42-9784-2e0933af4be4 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:21.916437 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c9b11dd4-7b29-4d42-9784-2e0933af4be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:21.924588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:21.925136 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:21.925405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:21.925676 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:21.926328 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:21.926628 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:21.928534 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:21.937038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 32/66] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:21.942044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:21.988084 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 35/67] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:21.989058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b11dd4-7b29-4d42-9784-2e0933af4be4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:21.992002 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.056467 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3db7-435f-469c-a6ce-cd46f48831eb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.077413 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.092766 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24376a-a668-41e2-9194-829c68004cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.093392 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24376a-a668-41e2-9194-829c68004cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.093761 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24376a-a668-41e2-9194-829c68004cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.093940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24376a-a668-41e2-9194-829c68004cb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.098004 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b11dd4-7b29-4d42-9784-2e0933af4be4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.104852 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24376a-a668-41e2-9194-829c68004cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1c24376a-a668-41e2-9194-829c68004cb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:22.109778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:22.110609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:22.111409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 33/68] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:22.112660 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24376a-a668-41e2-9194-829c68004cb0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.140891 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.141615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.141896 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.142287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.142948 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:22.143283 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.144765 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.158171 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 36/69] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:27:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.158171 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.217952 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.221497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24376a-a668-41e2-9194-829c68004cb0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.258119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04783d4-acca-4e52-bd78-9315fe5933e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.258757 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04783d4-acca-4e52-bd78-9315fe5933e1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.259038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04783d4-acca-4e52-bd78-9315fe5933e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.259353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04783d4-acca-4e52-bd78-9315fe5933e1 None admin] PATH_INFO: `/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.265417 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70d59d-dbdd-4635-957d-4aea8eab79c2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.275001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04783d4-acca-4e52-bd78-9315fe5933e1 None admin] RBAC: Authorizing `identity:get_user(user_id=27e48a27bdb640c69e8aa0884b8aaa0d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.276493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04783d4-acca-4e52-bd78-9315fe5933e1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.278130 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 34/70] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.279892 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04783d4-acca-4e52-bd78-9315fe5933e1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.300145 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bb67b-7095-4e1f-b809-90f63b38660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.300777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bb67b-7095-4e1f-b809-90f63b38660c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.301058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bb67b-7095-4e1f-b809-90f63b38660c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.301342 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bb67b-7095-4e1f-b809-90f63b38660c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.312368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bb67b-7095-4e1f-b809-90f63b38660c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-972bb67b-7095-4e1f-b809-90f63b38660c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:22.317648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:22.318800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 37/71] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:22.319658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bb67b-7095-4e1f-b809-90f63b38660c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.322967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.383741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04783d4-acca-4e52-bd78-9315fe5933e1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.417503 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.418098 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.418263 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bb67b-7095-4e1f-b809-90f63b38660c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.418462 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.418630 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.419310 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:22.419612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.420974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.428841 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 35/72] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.429609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.450336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.454776 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601feb67-71f1-44fe-b5b2-6bd5517d6109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.455444 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601feb67-71f1-44fe-b5b2-6bd5517d6109 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.455725 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601feb67-71f1-44fe-b5b2-6bd5517d6109 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.455999 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601feb67-71f1-44fe-b5b2-6bd5517d6109 None admin] PATH_INFO: `/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.457128 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601feb67-71f1-44fe-b5b2-6bd5517d6109 None admin] RBAC: Authorizing `identity:get_user(user_id=27e48a27bdb640c69e8aa0884b8aaa0d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.459105 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601feb67-71f1-44fe-b5b2-6bd5517d6109 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.465134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 38/73] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.465134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601feb67-71f1-44fe-b5b2-6bd5517d6109 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.528240 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d47ce-1752-46df-b151-bd57abbc1e69 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.529832 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.559501 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601feb67-71f1-44fe-b5b2-6bd5517d6109 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.562583 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803c32e-0d0b-4a01-8290-9db60ff57dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.563208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c32e-0d0b-4a01-8290-9db60ff57dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.563521 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c32e-0d0b-4a01-8290-9db60ff57dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.563800 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c32e-0d0b-4a01-8290-9db60ff57dd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.564922 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803c32e-0d0b-4a01-8290-9db60ff57dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.566373 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803c32e-0d0b-4a01-8290-9db60ff57dd9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.568541 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 36/74] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.573899 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803c32e-0d0b-4a01-8290-9db60ff57dd9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.593181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e18f9-7b54-4902-8da0-14816df32ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.593816 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e18f9-7b54-4902-8da0-14816df32ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.594124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e18f9-7b54-4902-8da0-14816df32ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.594400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e18f9-7b54-4902-8da0-14816df32ea9 None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.595557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e18f9-7b54-4902-8da0-14816df32ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.597020 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e18f9-7b54-4902-8da0-14816df32ea9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.598673 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 39/75] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.599995 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e18f9-7b54-4902-8da0-14816df32ea9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.660949 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.676553 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803c32e-0d0b-4a01-8290-9db60ff57dd9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.703078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e18f9-7b54-4902-8da0-14816df32ea9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.711515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.712115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.712389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.712658 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.713455 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:22.713751 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.715118 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.723200 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 37/76] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.724005 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.739632 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8bf07-7bbb-4478-aeca-d5945a91e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.740850 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8bf07-7bbb-4478-aeca-d5945a91e9ed None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.741125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8bf07-7bbb-4478-aeca-d5945a91e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.741393 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8bf07-7bbb-4478-aeca-d5945a91e9ed None admin] PATH_INFO: `/v3/users/abc5671b261f45af8270d5381600d177` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.742513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8bf07-7bbb-4478-aeca-d5945a91e9ed None admin] RBAC: Authorizing `identity:get_user(user_id=abc5671b261f45af8270d5381600d177)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.743998 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8bf07-7bbb-4478-aeca-d5945a91e9ed None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.745708 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 40/77] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/users/abc5671b261f45af8270d5381600d177 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.746304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8bf07-7bbb-4478-aeca-d5945a91e9ed None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.757088 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.829233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a773f-ab6d-4a32-aa57-6950a65ba128 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.847366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8bf07-7bbb-4478-aeca-d5945a91e9ed None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.863971 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afdc4e-c806-46bb-acfb-6815ef9a6edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.865485 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afdc4e-c806-46bb-acfb-6815ef9a6edf None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.865762 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afdc4e-c806-46bb-acfb-6815ef9a6edf None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.866033 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afdc4e-c806-46bb-acfb-6815ef9a6edf None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.867184 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afdc4e-c806-46bb-acfb-6815ef9a6edf None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.869064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afdc4e-c806-46bb-acfb-6815ef9a6edf None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.870832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 38/78] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:22.871590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afdc4e-c806-46bb-acfb-6815ef9a6edf None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.884835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b560-1612-4054-b3b2-300e7f76a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:22.885448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b560-1612-4054-b3b2-300e7f76a760 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:22.885730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b560-1612-4054-b3b2-300e7f76a760 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:22.886007 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680b560-1612-4054-b3b2-300e7f76a760 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:22.886655 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b560-1612-4054-b3b2-300e7f76a760 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:22.888143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680b560-1612-4054-b3b2-300e7f76a760 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:22.890637 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:22.910008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 41/79] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:27:22 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:22.910822 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b560-1612-4054-b3b2-300e7f76a760 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:22.986681 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afdc4e-c806-46bb-acfb-6815ef9a6edf None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:22.988542 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:23.027173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db33e21-9472-4a70-9417-e6e182512b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:23.027894 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db33e21-9472-4a70-9417-e6e182512b2b None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:23.028178 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db33e21-9472-4a70-9417-e6e182512b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:23.028460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db33e21-9472-4a70-9417-e6e182512b2b None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b/users/27e48a27bdb640c69e8aa0884b8aaa0d/roles/9e0338b743904d8ea8d77f7cea397655` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:23.030489 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db33e21-9472-4a70-9417-e6e182512b2b None admin] RBAC: Authorizing `identity:create_grant(project_id=aaa83f531a904af69ed3a6154f029a5b, user_id=27e48a27bdb640c69e8aa0884b8aaa0d, role_id=9e0338b743904d8ea8d77f7cea397655)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:23.031989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db33e21-9472-4a70-9417-e6e182512b2b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:23.036291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680b560-1612-4054-b3b2-300e7f76a760 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:23.055286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 39/80] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:22 2022] PUT /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b/users/27e48a27bdb640c69e8aa0884b8aaa0d/roles/9e0338b743904d8ea8d77f7cea397655 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:23.055286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db33e21-9472-4a70-9417-e6e182512b2b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:23.077674 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca624-1b61-4a09-91e8-06d91b2f1d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:23.078348 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca624-1b61-4a09-91e8-06d91b2f1d80 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:23.078700 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca624-1b61-4a09-91e8-06d91b2f1d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:23.079079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ca624-1b61-4a09-91e8-06d91b2f1d80 None admin] PATH_INFO: `/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:23.080413 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ca624-1b61-4a09-91e8-06d91b2f1d80 None admin] RBAC: Authorizing `identity:get_user(user_id=27e48a27bdb640c69e8aa0884b8aaa0d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:23.082031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ca624-1b61-4a09-91e8-06d91b2f1d80 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:23.088904 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 42/81] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:22 2022] GET /identity/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:23.088904 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca624-1b61-4a09-91e8-06d91b2f1d80 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:23.198221 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:23.212898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db33e21-9472-4a70-9417-e6e182512b2b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:23.231105 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ca624-1b61-4a09-91e8-06d91b2f1d80 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:23.259868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5896-4b15-4de5-a6af-fecb386c26a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:23.260603 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5896-4b15-4de5-a6af-fecb386c26a3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:23.260886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5896-4b15-4de5-a6af-fecb386c26a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:23.261161 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5896-4b15-4de5-a6af-fecb386c26a3 None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:23.263633 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e5896-4b15-4de5-a6af-fecb386c26a3 None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:23.265172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e5896-4b15-4de5-a6af-fecb386c26a3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:23.267132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 40/82] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:23 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:23.272760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5896-4b15-4de5-a6af-fecb386c26a3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:23.274496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:23.282586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40723b20-5595-43c8-b8b7-1d78a17f56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:23.283779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723b20-5595-43c8-b8b7-1d78a17f56ca None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:23.284061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723b20-5595-43c8-b8b7-1d78a17f56ca None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:23.284341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40723b20-5595-43c8-b8b7-1d78a17f56ca None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b/users/27e48a27bdb640c69e8aa0884b8aaa0d/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:23.286671 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40723b20-5595-43c8-b8b7-1d78a17f56ca None admin] RBAC: Authorizing `identity:create_grant(project_id=aaa83f531a904af69ed3a6154f029a5b, user_id=27e48a27bdb640c69e8aa0884b8aaa0d, role_id=bfb1cb6dbfcf40ad9ba6b353b461eea6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:23.289205 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40723b20-5595-43c8-b8b7-1d78a17f56ca None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:23.309133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 43/83] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:23 2022] PUT /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b/users/27e48a27bdb640c69e8aa0884b8aaa0d/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:23.310712 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40723b20-5595-43c8-b8b7-1d78a17f56ca None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:23.434695 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5896-4b15-4de5-a6af-fecb386c26a3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:23.508637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40723b20-5595-43c8-b8b7-1d78a17f56ca None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:23.514820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e746bc-5311-4454-b068-b334c2c23dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:23.515591 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e746bc-5311-4454-b068-b334c2c23dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:23.516173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e746bc-5311-4454-b068-b334c2c23dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:23.517271 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e746bc-5311-4454-b068-b334c2c23dd1 None admin] PATH_INFO: `/v3/projects/09ea1d61234a47dc94135e93907b7b50` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:23.518765 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e746bc-5311-4454-b068-b334c2c23dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=09ea1d61234a47dc94135e93907b7b50)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:23.523741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e746bc-5311-4454-b068-b334c2c23dd1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:23.526068 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 41/84] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:23 2022] GET /identity/v3/projects/09ea1d61234a47dc94135e93907b7b50 => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:23.531671 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e746bc-5311-4454-b068-b334c2c23dd1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:23.559124 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:23.560304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0a3a0-b481-4f3a-bf85-d4d2f45cd5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:23.561002 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a3a0-b481-4f3a-bf85-d4d2f45cd5e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:23.561412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a3a0-b481-4f3a-bf85-d4d2f45cd5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:23.561884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0a3a0-b481-4f3a-bf85-d4d2f45cd5e9 None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b/users/abc5671b261f45af8270d5381600d177/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:23.564393 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0a3a0-b481-4f3a-bf85-d4d2f45cd5e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=aaa83f531a904af69ed3a6154f029a5b, user_id=abc5671b261f45af8270d5381600d177, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:23.566074 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0a3a0-b481-4f3a-bf85-d4d2f45cd5e9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:23.584534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 44/85] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:23 2022] PUT /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b/users/abc5671b261f45af8270d5381600d177/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:23.671199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e746bc-5311-4454-b068-b334c2c23dd1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:23.725149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e8130-3f8a-4874-b14d-3c6c0b8b50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:23.725950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8130-3f8a-4874-b14d-3c6c0b8b50b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:23.726332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8130-3f8a-4874-b14d-3c6c0b8b50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:23.726708 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e8130-3f8a-4874-b14d-3c6c0b8b50b9 None admin] PATH_INFO: `/v3/projects/09ea1d61234a47dc94135e93907b7b50/users/27e48a27bdb640c69e8aa0884b8aaa0d/roles/9e0338b743904d8ea8d77f7cea397655` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:23.728839 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e8130-3f8a-4874-b14d-3c6c0b8b50b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=09ea1d61234a47dc94135e93907b7b50, user_id=27e48a27bdb640c69e8aa0884b8aaa0d, role_id=9e0338b743904d8ea8d77f7cea397655)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:23.730389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e8130-3f8a-4874-b14d-3c6c0b8b50b9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:23.754135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 42/86] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:23 2022] PUT /identity/v3/projects/09ea1d61234a47dc94135e93907b7b50/users/27e48a27bdb640c69e8aa0884b8aaa0d/roles/9e0338b743904d8ea8d77f7cea397655 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:27:25.783618 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1889eb-a7db-44eb-95a1-6fdddde911d1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:25.784141 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1889eb-a7db-44eb-95a1-6fdddde911d1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:25.784475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1889eb-a7db-44eb-95a1-6fdddde911d1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:25.786114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 45/87] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:25.801016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb0f5-3e89-4204-ae64-9cfe754c1533 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:25.801481 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb0f5-3e89-4204-ae64-9cfe754c1533 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:25.801818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cb0f5-3e89-4204-ae64-9cfe754c1533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:25.825758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-380cb0f5-3e89-4204-ae64-9cfe754c1533 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:25.831299 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-380cb0f5-3e89-4204-ae64-9cfe754c1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:25.915764 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 43/88] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:26.407995 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e8e29-0f2b-422a-8f94-dcffd903fed1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:26.408335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e8e29-0f2b-422a-8f94-dcffd903fed1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:26.408663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e8e29-0f2b-422a-8f94-dcffd903fed1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:26.410269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 46/89] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:26.416340 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b1e72-168c-49df-ab83-23f12dead81c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:26.416625 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b1e72-168c-49df-ab83-23f12dead81c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:26.416899 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b1e72-168c-49df-ab83-23f12dead81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:26.424145 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:26.438772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-445b1e72-168c-49df-ab83-23f12dead81c None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:26.439976 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-445b1e72-168c-49df-ab83-23f12dead81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:26.453625 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e8e29-0f2b-422a-8f94-dcffd903fed1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:26.557427 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 44/90] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:26.572968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:26.606107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efab8-f687-4409-a7c8-6fc9bf0179a0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:26.606409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efab8-f687-4409-a7c8-6fc9bf0179a0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:26.606664 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4efab8-f687-4409-a7c8-6fc9bf0179a0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:26.609249 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 45/91] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:26.615360 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655733-45a4-4293-b5dc-b594e953b319 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:26.615640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655733-45a4-4293-b5dc-b594e953b319 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:26.615985 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac655733-45a4-4293-b5dc-b594e953b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:26.645901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ac655733-45a4-4293-b5dc-b594e953b319 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:26.648581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ac655733-45a4-4293-b5dc-b594e953b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:26.665777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e8e29-0f2b-422a-8f94-dcffd903fed1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:26.732886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff63b7-625f-44fb-8113-4ce2f70b284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:26.733541 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff63b7-625f-44fb-8113-4ce2f70b284c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:26.733828 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff63b7-625f-44fb-8113-4ce2f70b284c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:26.734102 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff63b7-625f-44fb-8113-4ce2f70b284c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:26.757294 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff63b7-625f-44fb-8113-4ce2f70b284c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-21ff63b7-625f-44fb-8113-4ce2f70b284c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:26.765684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:26.766638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:26.767454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 47/92] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:26.780265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff63b7-625f-44fb-8113-4ce2f70b284c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:26.799041 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 46/93] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:26.859559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ecdc5-eb41-4160-9cca-1f7d96d18bee None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:26.860513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ecdc5-eb41-4160-9cca-1f7d96d18bee None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:26.860954 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ecdc5-eb41-4160-9cca-1f7d96d18bee None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:26.862937 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 47/94] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:27:26.869735 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfea39-61c3-4950-b216-af9cd923e922 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:26.870241 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfea39-61c3-4950-b216-af9cd923e922 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:26.870658 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfea39-61c3-4950-b216-af9cd923e922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:26.890762 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0edfea39-61c3-4950-b216-af9cd923e922 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:26.892391 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0edfea39-61c3-4950-b216-af9cd923e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:26.995701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:27.005474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff63b7-625f-44fb-8113-4ce2f70b284c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:27.007231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 48/95] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:27.010133 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b814-b879-4a16-b425-e7b276cb1e04 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.010561 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b814-b879-4a16-b425-e7b276cb1e04 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.011032 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04b814-b879-4a16-b425-e7b276cb1e04 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.017801 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 49/96] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:27.024122 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619de6d-500c-412b-8e9d-f882e09d7b23 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.024612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619de6d-500c-412b-8e9d-f882e09d7b23 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.025026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619de6d-500c-412b-8e9d-f882e09d7b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.041052 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:27.057704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f619de6d-500c-412b-8e9d-f882e09d7b23 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:27.061098 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f619de6d-500c-412b-8e9d-f882e09d7b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:27.091962 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:27.092578 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.092854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.093129 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.093799 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:27.094098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:27.099721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:27.109469 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:27.110347 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:27.173366 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 50/98] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:27.174289 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619de6d-500c-412b-8e9d-f882e09d7b23 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:27.281789 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b3fcc-c1e1-4cd1-a782-45953eccf396 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:27.313660 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619de6d-500c-412b-8e9d-f882e09d7b23 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:27.322675 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e5ee0-66da-4846-806f-783b28a1bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:27.323341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e5ee0-66da-4846-806f-783b28a1bdda None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.323639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e5ee0-66da-4846-806f-783b28a1bdda None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.323897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e5ee0-66da-4846-806f-783b28a1bdda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.325024 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e5ee0-66da-4846-806f-783b28a1bdda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:27.326461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e5ee0-66da-4846-806f-783b28a1bdda None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:27.332514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 49/99] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:27.332514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e5ee0-66da-4846-806f-783b28a1bdda None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:27.343396 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:27.355656 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db5cd8-f0a8-470d-afe4-31f6a45b7a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:27.356303 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5cd8-f0a8-470d-afe4-31f6a45b7a14 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.356567 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5cd8-f0a8-470d-afe4-31f6a45b7a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.356841 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5cd8-f0a8-470d-afe4-31f6a45b7a14 None admin] PATH_INFO: `/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.357961 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5cd8-f0a8-470d-afe4-31f6a45b7a14 None admin] RBAC: Authorizing `identity:get_user(user_id=27e48a27bdb640c69e8aa0884b8aaa0d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:27.359432 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5cd8-f0a8-470d-afe4-31f6a45b7a14 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:27.361204 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 51/100] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:27 2022] GET /identity/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:27.362115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492eee4-c6cf-4ddb-83e4-8c73ca9bbd04 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.362397 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492eee4-c6cf-4ddb-83e4-8c73ca9bbd04 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.362669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492eee4-c6cf-4ddb-83e4-8c73ca9bbd04 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.367979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 52/101] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:27.368756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492eee4-c6cf-4ddb-83e4-8c73ca9bbd04 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:27.381872 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:27.440962 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e5ee0-66da-4846-806f-783b28a1bdda None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:27.477539 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150e2e-a215-4a15-bc7d-06bc7b68966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:27.478167 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150e2e-a215-4a15-bc7d-06bc7b68966a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.478445 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150e2e-a215-4a15-bc7d-06bc7b68966a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.478755 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150e2e-a215-4a15-bc7d-06bc7b68966a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.479632 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492eee4-c6cf-4ddb-83e4-8c73ca9bbd04 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:27.489565 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92150e2e-a215-4a15-bc7d-06bc7b68966a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-92150e2e-a215-4a15-bc7d-06bc7b68966a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:27.495461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:27.496321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:27.497139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 50/102] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:27:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:27.497759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150e2e-a215-4a15-bc7d-06bc7b68966a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:27.515726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5f7f-7e1d-4a71-8928-6ce58b90fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:27.516356 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5f7f-7e1d-4a71-8928-6ce58b90fa68 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.516638 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5f7f-7e1d-4a71-8928-6ce58b90fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.516914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c5f7f-7e1d-4a71-8928-6ce58b90fa68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.527885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c5f7f-7e1d-4a71-8928-6ce58b90fa68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-647c5f7f-7e1d-4a71-8928-6ce58b90fa68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:27.533159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:27.534007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:27.534799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 53/103] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:27.535447 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5f7f-7e1d-4a71-8928-6ce58b90fa68 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:27.587669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:27.598235 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150e2e-a215-4a15-bc7d-06bc7b68966a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:27.599741 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:27.633088 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f045a-abce-46c0-afa9-1c075b210ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:27.633721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f045a-abce-46c0-afa9-1c075b210ee0 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.634000 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f045a-abce-46c0-afa9-1c075b210ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.634277 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f045a-abce-46c0-afa9-1c075b210ee0 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.634921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f045a-abce-46c0-afa9-1c075b210ee0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:27.636225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c5f7f-7e1d-4a71-8928-6ce58b90fa68 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:27.636464 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f045a-abce-46c0-afa9-1c075b210ee0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:27.663549 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 51/104] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:27:27 2022] POST /identity/v3/projects => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:27.665155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2c1a-3795-4e08-80c7-e551791cd153 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.665574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2c1a-3795-4e08-80c7-e551791cd153 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.665977 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2c1a-3795-4e08-80c7-e551791cd153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.669673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295672ea-bf9f-4570-893b-930b23da5d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:27.670498 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295672ea-bf9f-4570-893b-930b23da5d93 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.670947 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295672ea-bf9f-4570-893b-930b23da5d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.671385 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295672ea-bf9f-4570-893b-930b23da5d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.687750 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-002f2c1a-3795-4e08-80c7-e551791cd153 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:27.688977 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-002f2c1a-3795-4e08-80c7-e551791cd153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:27.752075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295672ea-bf9f-4570-893b-930b23da5d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:27.753575 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295672ea-bf9f-4570-893b-930b23da5d93 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:27.767524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 52/105] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:27.768619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2c1a-3795-4e08-80c7-e551791cd153 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:27.827635 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:27.882924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:27.888901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 54/106] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:27.891567 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295672ea-bf9f-4570-893b-930b23da5d93 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:27.905899 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2c1a-3795-4e08-80c7-e551791cd153 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:27.950252 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd92e5-6d74-4b53-8e33-6561c8cf335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:27.951030 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd92e5-6d74-4b53-8e33-6561c8cf335a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:27.951343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd92e5-6d74-4b53-8e33-6561c8cf335a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:27.951618 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd92e5-6d74-4b53-8e33-6561c8cf335a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:27.963131 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd92e5-6d74-4b53-8e33-6561c8cf335a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7ccd92e5-6d74-4b53-8e33-6561c8cf335a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:27.968343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:27.969191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:27.970173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 53/107] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:27.970795 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd92e5-6d74-4b53-8e33-6561c8cf335a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.032286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295672ea-bf9f-4570-893b-930b23da5d93 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.072728 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.073332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.073668 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.073938 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.074604 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:28.074901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.076387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.085105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 55/108] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:27:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.085899 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.091198 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd92e5-6d74-4b53-8e33-6561c8cf335a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.101777 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:28.128162 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.128766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.129042 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.129311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.130225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:28.131113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.132597 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.141052 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 54/109] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.145622 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.153421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:28.198281 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7973e-d6f4-40fe-9731-3fc90222617d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.237266 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd42f1-8efe-40da-926e-f3d0ab371c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.237899 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd42f1-8efe-40da-926e-f3d0ab371c0d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.238600 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd42f1-8efe-40da-926e-f3d0ab371c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.238875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd42f1-8efe-40da-926e-f3d0ab371c0d None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.240329 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd42f1-8efe-40da-926e-f3d0ab371c0d None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.241784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd42f1-8efe-40da-926e-f3d0ab371c0d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.247415 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 56/110] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.248212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd42f1-8efe-40da-926e-f3d0ab371c0d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.256899 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007257c0-1ae7-42a0-8711-64fc83269dfb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.292367 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23574a35-5757-447d-9492-c8735797840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.292983 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23574a35-5757-447d-9492-c8735797840d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.293263 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23574a35-5757-447d-9492-c8735797840d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.293537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23574a35-5757-447d-9492-c8735797840d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.294202 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23574a35-5757-447d-9492-c8735797840d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:28.294506 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23574a35-5757-447d-9492-c8735797840d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.295925 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23574a35-5757-447d-9492-c8735797840d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.305027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 55/111] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.306044 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23574a35-5757-447d-9492-c8735797840d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.342722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:28.362620 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd42f1-8efe-40da-926e-f3d0ab371c0d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.375094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:28.400311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26ee7-19e5-41fd-8363-43f1df677720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.400945 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26ee7-19e5-41fd-8363-43f1df677720 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.401224 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26ee7-19e5-41fd-8363-43f1df677720 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.401495 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26ee7-19e5-41fd-8363-43f1df677720 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.411592 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23574a35-5757-447d-9492-c8735797840d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.412515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26ee7-19e5-41fd-8363-43f1df677720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b5a26ee7-19e5-41fd-8363-43f1df677720 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:28.417920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:28.418767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 57/112] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:28.424726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26ee7-19e5-41fd-8363-43f1df677720 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.454642 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929c5b1-f44e-4d9a-9fb4-e5f584a6ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.455292 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c5b1-f44e-4d9a-9fb4-e5f584a6ff7a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.455587 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c5b1-f44e-4d9a-9fb4-e5f584a6ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.455844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929c5b1-f44e-4d9a-9fb4-e5f584a6ff7a None admin] PATH_INFO: `/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.456974 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929c5b1-f44e-4d9a-9fb4-e5f584a6ff7a None admin] RBAC: Authorizing `identity:get_user(user_id=27e48a27bdb640c69e8aa0884b8aaa0d)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.458443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929c5b1-f44e-4d9a-9fb4-e5f584a6ff7a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.464624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 56/113] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.464624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929c5b1-f44e-4d9a-9fb4-e5f584a6ff7a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.532474 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26ee7-19e5-41fd-8363-43f1df677720 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.568461 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878a30-b65a-4865-a6f7-fc8dea4f34df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.569085 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878a30-b65a-4865-a6f7-fc8dea4f34df None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.569362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878a30-b65a-4865-a6f7-fc8dea4f34df None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.569629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878a30-b65a-4865-a6f7-fc8dea4f34df None admin] PATH_INFO: `/v3/users/6c76f9097e7b4cff9be67f0682384bb6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.570009 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929c5b1-f44e-4d9a-9fb4-e5f584a6ff7a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.581588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:28.584334 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f878a30-b65a-4865-a6f7-fc8dea4f34df None admin] RBAC: Authorizing `identity:get_user(user_id=6c76f9097e7b4cff9be67f0682384bb6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.586372 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f878a30-b65a-4865-a6f7-fc8dea4f34df None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.588695 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 58/114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/users/6c76f9097e7b4cff9be67f0682384bb6 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.589645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878a30-b65a-4865-a6f7-fc8dea4f34df None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.610758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.611398 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.611681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.611952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.612676 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] RBAC: Adding query filter params (role.id=9e0338b743904d8ea8d77f7cea397655, scope.project.id=aaa83f531a904af69ed3a6154f029a5b, user.id=27e48a27bdb640c69e8aa0884b8aaa0d) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:28.612983 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.614422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.618952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:28.625324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 57/115] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/role_assignments?user.id=27e48a27bdb640c69e8aa0884b8aaa0d&scope.project.id=aaa83f531a904af69ed3a6154f029a5b&role.id=9e0338b743904d8ea8d77f7cea397655 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.626301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.707493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878a30-b65a-4865-a6f7-fc8dea4f34df None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.749435 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0003fa-3877-416e-ba68-a7fb8fe147bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.750130 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0003fa-3877-416e-ba68-a7fb8fe147bf None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.750410 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0003fa-3877-416e-ba68-a7fb8fe147bf None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.750730 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0003fa-3877-416e-ba68-a7fb8fe147bf None admin] PATH_INFO: `/v3/users/abc5671b261f45af8270d5381600d177` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.751970 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0003fa-3877-416e-ba68-a7fb8fe147bf None admin] RBAC: Authorizing `identity:get_user(user_id=abc5671b261f45af8270d5381600d177)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.753372 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0003fa-3877-416e-ba68-a7fb8fe147bf None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.755303 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 59/116] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/users/abc5671b261f45af8270d5381600d177 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.756366 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0003fa-3877-416e-ba68-a7fb8fe147bf None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.787662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18206593-96a2-41fa-a350-edbecf0ea8ab None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.832746 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.833656 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.834516 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.834516 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.837340 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:28.837340 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:28.837340 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:28.845908 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 58/117] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:28.848056 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:28.856482 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:28.904111 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0003fa-3877-416e-ba68-a7fb8fe147bf None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:28.923472 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:28.945407 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1e1b8-6ebe-41d2-aeb1-70557335ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:28.946023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e1b8-6ebe-41d2-aeb1-70557335ec93 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:28.946306 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e1b8-6ebe-41d2-aeb1-70557335ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:28.946572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1e1b8-6ebe-41d2-aeb1-70557335ec93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:28.964281 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea050b58-523f-47f0-8c32-bacfd3a59e24 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.006945 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259e529-b2a7-4b4d-ac1e-19dbc32faa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.007978 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e529-b2a7-4b4d-ac1e-19dbc32faa6a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.008452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e529-b2a7-4b4d-ac1e-19dbc32faa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.008914 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e529-b2a7-4b4d-ac1e-19dbc32faa6a None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.010293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259e529-b2a7-4b4d-ac1e-19dbc32faa6a None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.011971 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259e529-b2a7-4b4d-ac1e-19dbc32faa6a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.014026 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 59/118] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:29.014952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259e529-b2a7-4b4d-ac1e-19dbc32faa6a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.024977 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1e1b8-6ebe-41d2-aeb1-70557335ec93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.026438 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1e1b8-6ebe-41d2-aeb1-70557335ec93 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.102578 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:29.121521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259e529-b2a7-4b4d-ac1e-19dbc32faa6a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.145184 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 60/119] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:29.145184 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1e1b8-6ebe-41d2-aeb1-70557335ec93 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.156385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:29.164040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad666aa-4a74-46bc-8f59-ff8b6aec1e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.164647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad666aa-4a74-46bc-8f59-ff8b6aec1e45 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.164924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad666aa-4a74-46bc-8f59-ff8b6aec1e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.165194 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad666aa-4a74-46bc-8f59-ff8b6aec1e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.232590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad666aa-4a74-46bc-8f59-ff8b6aec1e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.234060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad666aa-4a74-46bc-8f59-ff8b6aec1e45 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.248460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1e1b8-6ebe-41d2-aeb1-70557335ec93 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.285121 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0808-7c88-4797-b11f-a8d16721bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.285754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0808-7c88-4797-b11f-a8d16721bb6c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.286035 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0808-7c88-4797-b11f-a8d16721bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.286313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0808-7c88-4797-b11f-a8d16721bb6c None admin] PATH_INFO: `/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.288019 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b0808-7c88-4797-b11f-a8d16721bb6c None admin] RBAC: Authorizing `identity:get_user(user_id=27e48a27bdb640c69e8aa0884b8aaa0d)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.289464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b0808-7c88-4797-b11f-a8d16721bb6c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.291391 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 61/120] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:29 2022] GET /identity/v3/users/27e48a27bdb640c69e8aa0884b8aaa0d => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:29.292126 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0808-7c88-4797-b11f-a8d16721bb6c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.329201 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:29.346257 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 60/121] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:29.347231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad666aa-4a74-46bc-8f59-ff8b6aec1e45 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.381907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:29.403582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b0808-7c88-4797-b11f-a8d16721bb6c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.440327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb3486-607f-4377-8952-78ed0bbd93ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.440897 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3486-607f-4377-8952-78ed0bbd93ab None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.441207 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3486-607f-4377-8952-78ed0bbd93ab None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.441446 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3486-607f-4377-8952-78ed0bbd93ab None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b/users/6c76f9097e7b4cff9be67f0682384bb6/roles/07e01b6649654a428718e8c9400f41b1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.444051 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb3486-607f-4377-8952-78ed0bbd93ab None admin] RBAC: Authorizing `identity:create_grant(project_id=aaa83f531a904af69ed3a6154f029a5b, user_id=6c76f9097e7b4cff9be67f0682384bb6, role_id=07e01b6649654a428718e8c9400f41b1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.445486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb3486-607f-4377-8952-78ed0bbd93ab None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.467297 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 62/122] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:29 2022] PUT /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b/users/6c76f9097e7b4cff9be67f0682384bb6/roles/07e01b6649654a428718e8c9400f41b1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:29.467297 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb3486-607f-4377-8952-78ed0bbd93ab None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.467611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad666aa-4a74-46bc-8f59-ff8b6aec1e45 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.508889 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd71fb1-8435-402c-8839-6b25f2820b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.509632 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd71fb1-8435-402c-8839-6b25f2820b36 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.509979 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd71fb1-8435-402c-8839-6b25f2820b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.510320 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd71fb1-8435-402c-8839-6b25f2820b36 None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.511626 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd71fb1-8435-402c-8839-6b25f2820b36 None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.513302 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd71fb1-8435-402c-8839-6b25f2820b36 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.515749 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 61/123] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:29 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:29.516701 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd71fb1-8435-402c-8839-6b25f2820b36 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.580057 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:29.589759 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb3486-607f-4377-8952-78ed0bbd93ab None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.635810 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892e1e-51fa-4b66-bcd9-765d56ff7d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.636522 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892e1e-51fa-4b66-bcd9-765d56ff7d4d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.636869 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892e1e-51fa-4b66-bcd9-765d56ff7d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.637212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b892e1e-51fa-4b66-bcd9-765d56ff7d4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.663337 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:29.670074 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd71fb1-8435-402c-8839-6b25f2820b36 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.718677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b892e1e-51fa-4b66-bcd9-765d56ff7d4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.719962 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105019b-8c50-46ce-b1f4-be76963ba20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.720104 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b892e1e-51fa-4b66-bcd9-765d56ff7d4d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.720981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105019b-8c50-46ce-b1f4-be76963ba20d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.721543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105019b-8c50-46ce-b1f4-be76963ba20d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.722174 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105019b-8c50-46ce-b1f4-be76963ba20d None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.727958 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105019b-8c50-46ce-b1f4-be76963ba20d None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.730539 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105019b-8c50-46ce-b1f4-be76963ba20d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.733435 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:29 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:29.734591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105019b-8c50-46ce-b1f4-be76963ba20d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.821835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:29.830628 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 63/125] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:29.831868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892e1e-51fa-4b66-bcd9-765d56ff7d4d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.863137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105019b-8c50-46ce-b1f4-be76963ba20d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.902553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.903278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.903471 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.903742 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.904473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] RBAC: Adding query filter params (role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6, scope.project.id=aaa83f531a904af69ed3a6154f029a5b, user.id=27e48a27bdb640c69e8aa0884b8aaa0d) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:29.904783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.906423 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.913525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 63/126] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:29 2022] GET /identity/v3/role_assignments?user.id=27e48a27bdb640c69e8aa0884b8aaa0d&scope.project.id=aaa83f531a904af69ed3a6154f029a5b&role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:29.914175 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:29.945952 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b892e1e-51fa-4b66-bcd9-765d56ff7d4d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:29.952326 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:29.984473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106bf6b-17ac-4663-a4ff-560f542c8b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:29.985472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106bf6b-17ac-4663-a4ff-560f542c8b6b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.985824 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106bf6b-17ac-4663-a4ff-560f542c8b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:29.986167 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106bf6b-17ac-4663-a4ff-560f542c8b6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:29.986988 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106bf6b-17ac-4663-a4ff-560f542c8b6b None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=aaa83f531a904af69ed3a6154f029a5b, user.id=abc5671b261f45af8270d5381600d177) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:29.987408 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106bf6b-17ac-4663-a4ff-560f542c8b6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:29.989302 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106bf6b-17ac-4663-a4ff-560f542c8b6b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:29.998461 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 64/127] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:29 2022] GET /identity/v3/role_assignments?user.id=abc5671b261f45af8270d5381600d177&scope.project.id=aaa83f531a904af69ed3a6154f029a5b&role.id=78ddf427bf274205867c7492aec1f590 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:29.999318 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557273c-177f-4d72-860c-f49082095c11 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:29.999718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557273c-177f-4d72-860c-f49082095c11 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:30.000284 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557273c-177f-4d72-860c-f49082095c11 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:30.002461 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 65/128] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:30.009613 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256416-c9f1-422b-b942-9a996e8ff1fb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:30.010006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256416-c9f1-422b-b942-9a996e8ff1fb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:30.010430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256416-c9f1-422b-b942-9a996e8ff1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:30.035173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fe256416-c9f1-422b-b942-9a996e8ff1fb None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:30.037536 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fe256416-c9f1-422b-b942-9a996e8ff1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:30.050608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b8d47-ef54-4f8e-93db-691e38b062bb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:30.096000 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cc92c-6e7f-4e8f-84cd-45fb8c68d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:30.097053 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc92c-6e7f-4e8f-84cd-45fb8c68d318 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:30.097330 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc92c-6e7f-4e8f-84cd-45fb8c68d318 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:30.097613 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cc92c-6e7f-4e8f-84cd-45fb8c68d318 None admin] PATH_INFO: `/v3/projects/09ea1d61234a47dc94135e93907b7b50` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:30.100080 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cc92c-6e7f-4e8f-84cd-45fb8c68d318 None admin] RBAC: Authorizing `identity:get_project(project_id=09ea1d61234a47dc94135e93907b7b50)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:30.101738 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cc92c-6e7f-4e8f-84cd-45fb8c68d318 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:30.104563 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 64/129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:29 2022] GET /identity/v3/projects/09ea1d61234a47dc94135e93907b7b50 => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:30.112552 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cc92c-6e7f-4e8f-84cd-45fb8c68d318 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:30.115990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:30.128639 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 66/130] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:30.270884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:30.276703 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cc92c-6e7f-4e8f-84cd-45fb8c68d318 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:30.315395 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:30.316012 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:30.316295 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:30.316569 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:30.317303 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] RBAC: Adding query filter params (role.id=9e0338b743904d8ea8d77f7cea397655, scope.project.id=09ea1d61234a47dc94135e93907b7b50, user.id=27e48a27bdb640c69e8aa0884b8aaa0d) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:30.317611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:30.319590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:30.325968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 65/131] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:30 2022] GET /identity/v3/role_assignments?user.id=27e48a27bdb640c69e8aa0884b8aaa0d&scope.project.id=09ea1d61234a47dc94135e93907b7b50&role.id=9e0338b743904d8ea8d77f7cea397655 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:30.457534 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe256416-c9f1-422b-b942-9a996e8ff1fb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:30.570157 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe256416-c9f1-422b-b942-9a996e8ff1fb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:30.604016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9edcc-4297-415a-a601-727461750d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:30.604639 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9edcc-4297-415a-a601-727461750d64 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:30.604919 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9edcc-4297-415a-a601-727461750d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:30.605191 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9edcc-4297-415a-a601-727461750d64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:30.606307 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9edcc-4297-415a-a601-727461750d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:30.607769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9edcc-4297-415a-a601-727461750d64 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:30.609491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 67/132] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:30.614825 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:30.712931 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5632e-fc20-4f18-84e1-5a58d287c4b7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:30.745920 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d6a3e-b4e0-4c18-8dac-68fff95c0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:30.746521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6a3e-b4e0-4c18-8dac-68fff95c0850 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:30.746802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6a3e-b4e0-4c18-8dac-68fff95c0850 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:30.747078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6a3e-b4e0-4c18-8dac-68fff95c0850 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:30.747767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d6a3e-b4e0-4c18-8dac-68fff95c0850 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:30.749216 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d6a3e-b4e0-4c18-8dac-68fff95c0850 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:30.769733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 66/133] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:27:30 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:31.802995 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c0d2-103f-4c5e-86a2-8bdbf7285f5e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:31.803560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c0d2-103f-4c5e-86a2-8bdbf7285f5e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:31.803928 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c0d2-103f-4c5e-86a2-8bdbf7285f5e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:31.805358 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 68/134] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:31.810717 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b3ffb-f4f9-4ff8-8da5-284e997d880b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:31.811121 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b3ffb-f4f9-4ff8-8da5-284e997d880b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:31.811478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b3ffb-f4f9-4ff8-8da5-284e997d880b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:31.837993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-289b3ffb-f4f9-4ff8-8da5-284e997d880b None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:31.839171 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-289b3ffb-f4f9-4ff8-8da5-284e997d880b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:31.853596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:31.918335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 67/135] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:32.192534 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628c0d2-103f-4c5e-86a2-8bdbf7285f5e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:32.254866 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:32.299354 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628c0d2-103f-4c5e-86a2-8bdbf7285f5e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:32.335199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5f9ff-c50a-4531-a85b-f96c16f0638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:32.335851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f9ff-c50a-4531-a85b-f96c16f0638e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:32.336186 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f9ff-c50a-4531-a85b-f96c16f0638e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:32.336462 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5f9ff-c50a-4531-a85b-f96c16f0638e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:32.346530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5f9ff-c50a-4531-a85b-f96c16f0638e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0ca5f9ff-c50a-4531-a85b-f96c16f0638e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:32.351914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:32.352749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:32.353508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 69/136] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:32.358956 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b3ffb-f4f9-4ff8-8da5-284e997d880b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:32.459840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b3ffb-f4f9-4ff8-8da5-284e997d880b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:32.494350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:32.494955 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:32.495238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:32.495537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:32.496202 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:32.496507 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:32.497900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:32.507399 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 68/137] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:32.513233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5f9ff-c50a-4531-a85b-f96c16f0638e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:32.614190 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5f9ff-c50a-4531-a85b-f96c16f0638e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:32.633208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:32.653179 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78de90-9f4a-449b-a734-edce60aec421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:32.654198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78de90-9f4a-449b-a734-edce60aec421 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:32.654704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78de90-9f4a-449b-a734-edce60aec421 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:32.655171 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78de90-9f4a-449b-a734-edce60aec421 None admin] PATH_INFO: `/v3/users/6c76f9097e7b4cff9be67f0682384bb6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:32.656535 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78de90-9f4a-449b-a734-edce60aec421 None admin] RBAC: Authorizing `identity:get_user(user_id=6c76f9097e7b4cff9be67f0682384bb6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:32.658161 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78de90-9f4a-449b-a734-edce60aec421 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:32.660286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 70/138] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:32 2022] GET /identity/v3/users/6c76f9097e7b4cff9be67f0682384bb6 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:32.669226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:32.683647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:32.774229 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cfcca-5bff-4dc7-bec1-101ec030866d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:32.808861 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75c4d-3ab8-4fb6-a135-afd20cd98d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:32.809474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75c4d-3ab8-4fb6-a135-afd20cd98d1e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:32.809753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75c4d-3ab8-4fb6-a135-afd20cd98d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:32.810035 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75c4d-3ab8-4fb6-a135-afd20cd98d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:32.883870 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc75c4d-3ab8-4fb6-a135-afd20cd98d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:32.885337 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc75c4d-3ab8-4fb6-a135-afd20cd98d1e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:32.897791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:32.996594 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 69/139] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:33.002337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78de90-9f4a-449b-a734-edce60aec421 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:33.088694 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029a934-79f0-43aa-b11b-a0edc2332a42 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.089267 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029a934-79f0-43aa-b11b-a0edc2332a42 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.089729 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029a934-79f0-43aa-b11b-a0edc2332a42 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.091278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 70/140] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:27:33.096374 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331187-3a08-4e46-b572-9fd9501432e5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.096894 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331187-3a08-4e46-b572-9fd9501432e5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.097367 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331187-3a08-4e46-b572-9fd9501432e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.109830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78de90-9f4a-449b-a734-edce60aec421 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:33.117860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6c331187-3a08-4e46-b572-9fd9501432e5 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:33.119440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6c331187-3a08-4e46-b572-9fd9501432e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:33.156399 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef155e-3c46-4bd0-861d-201b8069c467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:33.157118 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef155e-3c46-4bd0-861d-201b8069c467 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.157578 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef155e-3c46-4bd0-861d-201b8069c467 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.157978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef155e-3c46-4bd0-861d-201b8069c467 None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.159645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef155e-3c46-4bd0-861d-201b8069c467 None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:33.161324 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef155e-3c46-4bd0-861d-201b8069c467 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:33.163840 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 71/141] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:33 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:33.170148 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef155e-3c46-4bd0-861d-201b8069c467 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:33.204747 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 71/142] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:33.231245 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:33.261214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cd53-6a3b-479e-b1e7-59f8fb2ff801 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.261815 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cd53-6a3b-479e-b1e7-59f8fb2ff801 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.262378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512cd53-6a3b-479e-b1e7-59f8fb2ff801 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.264064 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 72/143] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:33.269807 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4bee-84c4-4f76-8c49-e4174d9d61a6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.270761 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4bee-84c4-4f76-8c49-e4174d9d61a6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.271281 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e4bee-84c4-4f76-8c49-e4174d9d61a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.279416 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef155e-3c46-4bd0-861d-201b8069c467 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:33.290278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c16e4bee-84c4-4f76-8c49-e4174d9d61a6 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:33.291521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c16e4bee-84c4-4f76-8c49-e4174d9d61a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:33.316391 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8fe74-49bd-428a-90e1-0263eb827e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:33.317055 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fe74-49bd-428a-90e1-0263eb827e54 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.317342 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fe74-49bd-428a-90e1-0263eb827e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.317614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fe74-49bd-428a-90e1-0263eb827e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.318384 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8fe74-49bd-428a-90e1-0263eb827e54 None admin] RBAC: Adding query filter params (role.id=07e01b6649654a428718e8c9400f41b1, scope.project.id=aaa83f531a904af69ed3a6154f029a5b, user.id=6c76f9097e7b4cff9be67f0682384bb6) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:33.318758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8fe74-49bd-428a-90e1-0263eb827e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:33.320228 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8fe74-49bd-428a-90e1-0263eb827e54 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:33.331915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 72/144] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:33 2022] GET /identity/v3/role_assignments?user.id=6c76f9097e7b4cff9be67f0682384bb6&scope.project.id=aaa83f531a904af69ed3a6154f029a5b&role.id=07e01b6649654a428718e8c9400f41b1 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:33.331915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6132c-f467-43b3-ae3c-80b57c7fec3b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.331915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6132c-f467-43b3-ae3c-80b57c7fec3b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.331915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6132c-f467-43b3-ae3c-80b57c7fec3b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.331915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 73/145] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:33.332782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:33.341279 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced2c3-421a-4a0b-9515-d80d5f9db5d4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.341612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced2c3-421a-4a0b-9515-d80d5f9db5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.341992 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ced2c3-421a-4a0b-9515-d80d5f9db5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.363825 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a5ced2c3-421a-4a0b-9515-d80d5f9db5d4 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:33.366056 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a5ced2c3-421a-4a0b-9515-d80d5f9db5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:33.381614 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 73/146] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:33.446887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 74/147] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:33.494104 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e4bee-84c4-4f76-8c49-e4174d9d61a6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:33.600617 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e4bee-84c4-4f76-8c49-e4174d9d61a6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:33.635537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f85642-d897-40dc-adaf-d399a04ae1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:33.636177 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85642-d897-40dc-adaf-d399a04ae1dd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.636441 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85642-d897-40dc-adaf-d399a04ae1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.636710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85642-d897-40dc-adaf-d399a04ae1dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.647332 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f85642-d897-40dc-adaf-d399a04ae1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b5f85642-d897-40dc-adaf-d399a04ae1dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:33.652112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:33.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:33.653715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 74/148] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:33.658943 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ced2c3-421a-4a0b-9515-d80d5f9db5d4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:33.666105 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f85642-d897-40dc-adaf-d399a04ae1dd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:33.696579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:33.716579 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:33.769108 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ced2c3-421a-4a0b-9515-d80d5f9db5d4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:33.769490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f85642-d897-40dc-adaf-d399a04ae1dd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:33.802855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:33.803493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.803778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.804064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.804507 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25233370-cac4-465c-875c-f4a2ee02f479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:33.804722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:33.805023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:33.805127 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25233370-cac4-465c-875c-f4a2ee02f479 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.805388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25233370-cac4-465c-875c-f4a2ee02f479 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.805658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25233370-cac4-465c-875c-f4a2ee02f479 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.806429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:33.807130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25233370-cac4-465c-875c-f4a2ee02f479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:33.808601 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25233370-cac4-465c-875c-f4a2ee02f479 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:33.810486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 75/149] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:33.811414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25233370-cac4-465c-875c-f4a2ee02f479 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:33.814599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 75/150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:33.817153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:33.909229 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:33.913337 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25233370-cac4-465c-875c-f4a2ee02f479 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:33.918562 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae2893-9dec-4afa-8327-0ec52d6125ba None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:33.928739 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:33.947724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34c9a5-4927-41d5-b9f8-661fc8323352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:33.948340 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34c9a5-4927-41d5-b9f8-661fc8323352 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.948611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34c9a5-4927-41d5-b9f8-661fc8323352 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.948881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34c9a5-4927-41d5-b9f8-661fc8323352 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.953387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588b060-fbd8-42ce-bd7b-63be98787c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:33.953988 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588b060-fbd8-42ce-bd7b-63be98787c85 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:33.954266 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588b060-fbd8-42ce-bd7b-63be98787c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:33.954540 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588b060-fbd8-42ce-bd7b-63be98787c85 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:33.955192 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588b060-fbd8-42ce-bd7b-63be98787c85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:33.956763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588b060-fbd8-42ce-bd7b-63be98787c85 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:33.959523 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34c9a5-4927-41d5-b9f8-661fc8323352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8d34c9a5-4927-41d5-b9f8-661fc8323352 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:33.964287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:33.965182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:33.965967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 76/151] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:27:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:33.966593 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34c9a5-4927-41d5-b9f8-661fc8323352 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:33.986670 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 76/152] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:27:33 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:27:33.986670 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588b060-fbd8-42ce-bd7b-63be98787c85 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:34.081741 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34c9a5-4927-41d5-b9f8-661fc8323352 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:34.102925 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588b060-fbd8-42ce-bd7b-63be98787c85 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:34.120517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cccd72-4b5f-4edc-a3c8-ef6f017a8846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:34.121158 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cccd72-4b5f-4edc-a3c8-ef6f017a8846 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:34.121432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cccd72-4b5f-4edc-a3c8-ef6f017a8846 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:34.121703 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cccd72-4b5f-4edc-a3c8-ef6f017a8846 None admin] PATH_INFO: `/v3/users/7424d27f71b74dc5abbe1b92089f887c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:34.137439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cccd72-4b5f-4edc-a3c8-ef6f017a8846 None admin] RBAC: Authorizing `identity:get_user(user_id=7424d27f71b74dc5abbe1b92089f887c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:34.138929 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cccd72-4b5f-4edc-a3c8-ef6f017a8846 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:34.140671 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 77/153] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:33 2022] GET /identity/v3/users/7424d27f71b74dc5abbe1b92089f887c => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:34.141586 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:34.142269 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:34.142547 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:34.142814 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:34.143522 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:34.143819 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:34.145291 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:34.146889 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cccd72-4b5f-4edc-a3c8-ef6f017a8846 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:34.155073 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 77/154] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:27:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:34.160547 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:34.173491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:34.195404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:34.277559 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cccd72-4b5f-4edc-a3c8-ef6f017a8846 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:34.289525 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acb4da-d4bb-4f28-99b4-0f3a69877a23 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:34.325892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9701-4228-48db-963d-b4c8cbf16a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:34.326852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9701-4228-48db-963d-b4c8cbf16a2d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:34.327131 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9701-4228-48db-963d-b4c8cbf16a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:34.327444 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9701-4228-48db-963d-b4c8cbf16a2d None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:34.328567 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c9701-4228-48db-963d-b4c8cbf16a2d None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:34.330018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c9701-4228-48db-963d-b4c8cbf16a2d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:34.335660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 78/155] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:34 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:34.336843 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f01e91-e1a4-4cc4-a09f-39ad0c61d891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:34.337792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01e91-e1a4-4cc4-a09f-39ad0c61d891 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:34.338065 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01e91-e1a4-4cc4-a09f-39ad0c61d891 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:34.338335 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01e91-e1a4-4cc4-a09f-39ad0c61d891 None admin] PATH_INFO: `/v3/users/7424d27f71b74dc5abbe1b92089f887c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:34.338622 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9701-4228-48db-963d-b4c8cbf16a2d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:34.339504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f01e91-e1a4-4cc4-a09f-39ad0c61d891 None admin] RBAC: Authorizing `identity:get_user(user_id=7424d27f71b74dc5abbe1b92089f887c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:34.340932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f01e91-e1a4-4cc4-a09f-39ad0c61d891 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:34.343300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 78/156] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:34 2022] GET /identity/v3/users/7424d27f71b74dc5abbe1b92089f887c => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:34.348495 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f01e91-e1a4-4cc4-a09f-39ad0c61d891 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:34.452537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:34.472303 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:34.478096 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9701-4228-48db-963d-b4c8cbf16a2d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:34.483172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f01e91-e1a4-4cc4-a09f-39ad0c61d891 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:34.516050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef20d1a-f5be-46de-88aa-5964519140b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:34.516713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef20d1a-f5be-46de-88aa-5964519140b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:34.517048 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef20d1a-f5be-46de-88aa-5964519140b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:34.517289 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef20d1a-f5be-46de-88aa-5964519140b4 None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df/users/7424d27f71b74dc5abbe1b92089f887c/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:34.519148 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef20d1a-f5be-46de-88aa-5964519140b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=afad98494253442ca485960bb1d083df, user_id=7424d27f71b74dc5abbe1b92089f887c, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:34.520642 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef20d1a-f5be-46de-88aa-5964519140b4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:34.533086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334e3a7-db44-40b0-abaf-88c5d5c21c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:34.534080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e3a7-db44-40b0-abaf-88c5d5c21c2d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:34.534869 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e3a7-db44-40b0-abaf-88c5d5c21c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:34.535881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e3a7-db44-40b0-abaf-88c5d5c21c2d None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:34.538442 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334e3a7-db44-40b0-abaf-88c5d5c21c2d None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:34.540149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334e3a7-db44-40b0-abaf-88c5d5c21c2d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:34.540846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 79/157] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:34 2022] PUT /identity/v3/projects/afad98494253442ca485960bb1d083df/users/7424d27f71b74dc5abbe1b92089f887c/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:27:34.542230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 79/158] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:34 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:34.554257 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef20d1a-f5be-46de-88aa-5964519140b4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:34.680233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef20d1a-f5be-46de-88aa-5964519140b4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:34.722338 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727213-e685-4133-a701-6dacf5eec288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:34.722933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727213-e685-4133-a701-6dacf5eec288 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:34.723214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727213-e685-4133-a701-6dacf5eec288 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:34.723515 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727213-e685-4133-a701-6dacf5eec288 None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df/users/7424d27f71b74dc5abbe1b92089f887c/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:34.726774 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74727213-e685-4133-a701-6dacf5eec288 None admin] RBAC: Authorizing `identity:create_grant(project_id=afad98494253442ca485960bb1d083df, user_id=7424d27f71b74dc5abbe1b92089f887c, role_id=bfb1cb6dbfcf40ad9ba6b353b461eea6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:34.728320 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74727213-e685-4133-a701-6dacf5eec288 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:34.745636 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 80/159] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:34 2022] PUT /identity/v3/projects/afad98494253442ca485960bb1d083df/users/7424d27f71b74dc5abbe1b92089f887c/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:36.305165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa990ed-9579-4386-ab80-206f79567861 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.305717 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa990ed-9579-4386-ab80-206f79567861 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.305717 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa990ed-9579-4386-ab80-206f79567861 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.307064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 80/160] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:36.313069 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df8b76-30a1-4208-bcb1-144ecf928323 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.314044 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df8b76-30a1-4208-bcb1-144ecf928323 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.314512 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df8b76-30a1-4208-bcb1-144ecf928323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.322853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:36.337218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d6df8b76-30a1-4208-bcb1-144ecf928323 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:36.339043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d6df8b76-30a1-4208-bcb1-144ecf928323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:36.409145 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 81/161] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:36.413404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc93cf9-ae73-4e9c-8948-07e50348a6e0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.413873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc93cf9-ae73-4e9c-8948-07e50348a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.414396 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc93cf9-ae73-4e9c-8948-07e50348a6e0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.416166 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 81/162] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:36.421668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa1f3-420f-4a2d-a4d9-cb333fce3682 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.422139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa1f3-420f-4a2d-a4d9-cb333fce3682 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.422559 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0aa1f3-420f-4a2d-a4d9-cb333fce3682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.446329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8b0aa1f3-420f-4a2d-a4d9-cb333fce3682 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:36.447520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8b0aa1f3-420f-4a2d-a4d9-cb333fce3682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:36.516714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 82/163] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:36.687315 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc93cf9-ae73-4e9c-8948-07e50348a6e0 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:36.806862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655fdd2-c18b-47ca-a822-280f0a9f4375 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.807382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655fdd2-c18b-47ca-a822-280f0a9f4375 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.807909 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655fdd2-c18b-47ca-a822-280f0a9f4375 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.808506 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc93cf9-ae73-4e9c-8948-07e50348a6e0 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:36.809678 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 83/164] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:36.811524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655fdd2-c18b-47ca-a822-280f0a9f4375 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:36.855274 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28381216-7356-42d2-9dc1-76424392ee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:36.855914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381216-7356-42d2-9dc1-76424392ee5f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.856190 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381216-7356-42d2-9dc1-76424392ee5f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.856460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381216-7356-42d2-9dc1-76424392ee5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.868558 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28381216-7356-42d2-9dc1-76424392ee5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-28381216-7356-42d2-9dc1-76424392ee5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:36.873755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:36.874672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 82/165] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:36.881026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0023-8000-40df-968f-8bcf50a8b231 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.881856 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0023-8000-40df-968f-8bcf50a8b231 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.881856 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a0023-8000-40df-968f-8bcf50a8b231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.892864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:36.897805 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ac9a0023-8000-40df-968f-8bcf50a8b231 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:36.899380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ac9a0023-8000-40df-968f-8bcf50a8b231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:36.917773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:36.936116 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655fdd2-c18b-47ca-a822-280f0a9f4375 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:36.969750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 83/166] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:36.969924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45eff-ab10-4480-a2f9-e7f8427617aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:36.970396 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45eff-ab10-4480-a2f9-e7f8427617aa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.970504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a0023-8000-40df-968f-8bcf50a8b231 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:36.970671 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45eff-ab10-4480-a2f9-e7f8427617aa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.970937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45eff-ab10-4480-a2f9-e7f8427617aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.976025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca45eff-ab10-4480-a2f9-e7f8427617aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:36.977483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca45eff-ab10-4480-a2f9-e7f8427617aa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:36.979677 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:36.984500 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc96b88-063b-4d73-b458-d6b93a31c9e4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:36.984773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc96b88-063b-4d73-b458-d6b93a31c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:36.985035 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc96b88-063b-4d73-b458-d6b93a31c9e4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:36.986305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 85/168] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:36.987302 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc96b88-063b-4d73-b458-d6b93a31c9e4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.085161 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a0023-8000-40df-968f-8bcf50a8b231 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.092486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc96b88-063b-4d73-b458-d6b93a31c9e4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.122449 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:37.124009 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8c315-e368-4e0c-b0c3-7898e1027f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.124783 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c315-e368-4e0c-b0c3-7898e1027f90 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.124928 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c315-e368-4e0c-b0c3-7898e1027f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.125174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8c315-e368-4e0c-b0c3-7898e1027f90 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.125873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8c315-e368-4e0c-b0c3-7898e1027f90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:37.126211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8c315-e368-4e0c-b0c3-7898e1027f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:37.127670 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8c315-e368-4e0c-b0c3-7898e1027f90 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:37.129317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff37319-e5de-40bd-8753-c047942628d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.130750 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37319-e5de-40bd-8753-c047942628d9 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.130961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37319-e5de-40bd-8753-c047942628d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.131228 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff37319-e5de-40bd-8753-c047942628d9 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.131904 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff37319-e5de-40bd-8753-c047942628d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:37.133342 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff37319-e5de-40bd-8753-c047942628d9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:37.141756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 84/169] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:37.141756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c06c-c557-407c-aa87-3286aefaf452 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.141756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c06c-c557-407c-aa87-3286aefaf452 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.141756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896c06c-c557-407c-aa87-3286aefaf452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.156999 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 86/170] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:27:36 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:37.157373 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3896c06c-c557-407c-aa87-3286aefaf452 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:37.158608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3896c06c-c557-407c-aa87-3286aefaf452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:37.160323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff37319-e5de-40bd-8753-c047942628d9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.177883 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:37.251919 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 85/171] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:37.257422 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896c06c-c557-407c-aa87-3286aefaf452 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.281206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff37319-e5de-40bd-8753-c047942628d9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.320118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8a9a-f6d2-4283-a739-2ba88321a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.321565 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8a9a-f6d2-4283-a739-2ba88321a14d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.322097 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8a9a-f6d2-4283-a739-2ba88321a14d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.322545 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8a9a-f6d2-4283-a739-2ba88321a14d None admin] PATH_INFO: `/v3/users/b7dadc16072b458eb90fcef8af83a049` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.339408 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8a9a-f6d2-4283-a739-2ba88321a14d None admin] RBAC: Authorizing `identity:get_user(user_id=b7dadc16072b458eb90fcef8af83a049)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:37.341187 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d8a9a-f6d2-4283-a739-2ba88321a14d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:37.343764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 87/172] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:37 2022] GET /identity/v3/users/b7dadc16072b458eb90fcef8af83a049 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:37.349816 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8a9a-f6d2-4283-a739-2ba88321a14d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.380357 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896c06c-c557-407c-aa87-3286aefaf452 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.404947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:37.426265 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c994-d697-47ec-934c-a23aa648b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.426898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c994-d697-47ec-934c-a23aa648b45e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.427923 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c994-d697-47ec-934c-a23aa648b45e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.428257 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2c994-d697-47ec-934c-a23aa648b45e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.446426 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2c994-d697-47ec-934c-a23aa648b45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-81e2c994-d697-47ec-934c-a23aa648b45e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:37.452508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:37.453369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:37.454159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:37.457434 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 86/173] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:37.462784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c994-d697-47ec-934c-a23aa648b45e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.472610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:37.487359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8a9a-f6d2-4283-a739-2ba88321a14d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.535182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8e3f1-88c7-416a-b743-d0103abd2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.536149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8e3f1-88c7-416a-b743-d0103abd2fbb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.537400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8e3f1-88c7-416a-b743-d0103abd2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.537675 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8e3f1-88c7-416a-b743-d0103abd2fbb None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.538832 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8e3f1-88c7-416a-b743-d0103abd2fbb None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:37.541445 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8e3f1-88c7-416a-b743-d0103abd2fbb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:37.542308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 88/174] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:37 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:37.548231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8e3f1-88c7-416a-b743-d0103abd2fbb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.595175 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2c994-d697-47ec-934c-a23aa648b45e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.636210 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.636844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.637116 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.637382 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.639056 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:37.639056 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:37.639798 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:37.651037 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 87/175] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:37.652157 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.681424 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8e3f1-88c7-416a-b743-d0103abd2fbb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.697627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:37.721305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6da2-8df5-482b-92b5-c0a77e3078b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.722225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6da2-8df5-482b-92b5-c0a77e3078b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.722761 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6da2-8df5-482b-92b5-c0a77e3078b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.723142 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6da2-8df5-482b-92b5-c0a77e3078b8 None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df/users/b7dadc16072b458eb90fcef8af83a049/roles/9e0338b743904d8ea8d77f7cea397655` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.725911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea6da2-8df5-482b-92b5-c0a77e3078b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=afad98494253442ca485960bb1d083df, user_id=b7dadc16072b458eb90fcef8af83a049, role_id=9e0338b743904d8ea8d77f7cea397655)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:37.727508 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea6da2-8df5-482b-92b5-c0a77e3078b8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:37.739535 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:37.745231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 89/176] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:37 2022] PUT /identity/v3/projects/afad98494253442ca485960bb1d083df/users/b7dadc16072b458eb90fcef8af83a049/roles/9e0338b743904d8ea8d77f7cea397655 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:27:37.746058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6da2-8df5-482b-92b5-c0a77e3078b8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.812172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b38e1-4f2d-4db7-99e6-a38917500d2d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.919293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6da2-8df5-482b-92b5-c0a77e3078b8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:37.948208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc693f-4a37-48bc-9eee-b33d6c137801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.948865 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc693f-4a37-48bc-9eee-b33d6c137801 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.949138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc693f-4a37-48bc-9eee-b33d6c137801 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.949403 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc693f-4a37-48bc-9eee-b33d6c137801 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.970167 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc693f-4a37-48bc-9eee-b33d6c137801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:37.976196 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbfd7-b740-4069-ab65-c49e55e8f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:37.976849 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbfd7-b740-4069-ab65-c49e55e8f585 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-32fc693f-4a37-48bc-9eee-b33d6c137801 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:37.977080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:37.977934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:37.978727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:37.979953 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbfd7-b740-4069-ab65-c49e55e8f585 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:37.979953 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbfd7-b740-4069-ab65-c49e55e8f585 None admin] PATH_INFO: `/v3/users/7424d27f71b74dc5abbe1b92089f887c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:37.980519 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bbfd7-b740-4069-ab65-c49e55e8f585 None admin] RBAC: Authorizing `identity:get_user(user_id=7424d27f71b74dc5abbe1b92089f887c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:37.982261 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bbfd7-b740-4069-ab65-c49e55e8f585 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:37.982686 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 88/177] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:27:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:37.987547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 90/178] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:37 2022] GET /identity/v3/users/7424d27f71b74dc5abbe1b92089f887c => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:37.988656 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc693f-4a37-48bc-9eee-b33d6c137801 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:37.994777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbfd7-b740-4069-ab65-c49e55e8f585 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:38.054353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:38.125966 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbfd7-b740-4069-ab65-c49e55e8f585 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:38.145213 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc693f-4a37-48bc-9eee-b33d6c137801 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:38.165491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e20d64-fab6-4966-a15a-e5648fb60c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:38.166208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e20d64-fab6-4966-a15a-e5648fb60c66 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:38.166558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e20d64-fab6-4966-a15a-e5648fb60c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:38.166907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e20d64-fab6-4966-a15a-e5648fb60c66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:38.200592 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:38.216733 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:38.217349 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:38.217625 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:38.219968 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:38.220654 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:38.220959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:38.222349 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:38.243452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 89/179] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:27:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:38.249794 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:38.304960 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e20d64-fab6-4966-a15a-e5648fb60c66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:38.306491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e20d64-fab6-4966-a15a-e5648fb60c66 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:38.403729 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:38.464817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28e6d3-da40-444e-a847-d1f219cc28ca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:38.517813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b46b7a-f968-4b28-bb15-682886d23fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:38.518046 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 91/180] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:38.518741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46b7a-f968-4b28-bb15-682886d23fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:38.519020 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46b7a-f968-4b28-bb15-682886d23fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:38.519318 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b46b7a-f968-4b28-bb15-682886d23fd0 None admin] PATH_INFO: `/v3/users/7424d27f71b74dc5abbe1b92089f887c` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:38.520533 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b46b7a-f968-4b28-bb15-682886d23fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=7424d27f71b74dc5abbe1b92089f887c)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:38.522316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b46b7a-f968-4b28-bb15-682886d23fd0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:38.524144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 90/181] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:38 2022] GET /identity/v3/users/7424d27f71b74dc5abbe1b92089f887c => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:38.529375 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b46b7a-f968-4b28-bb15-682886d23fd0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:38.529510 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e20d64-fab6-4966-a15a-e5648fb60c66 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:38.594220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:38.636130 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b46b7a-f968-4b28-bb15-682886d23fd0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:38.673704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6425-7831-41ca-946c-2c6111df2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:38.674255 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6425-7831-41ca-946c-2c6111df2236 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:38.674534 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6425-7831-41ca-946c-2c6111df2236 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:38.674812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef6425-7831-41ca-946c-2c6111df2236 None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:38.675957 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef6425-7831-41ca-946c-2c6111df2236 None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:38.678285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef6425-7831-41ca-946c-2c6111df2236 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:38.680299 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 91/182] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:38 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:38.685995 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6425-7831-41ca-946c-2c6111df2236 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:38.779033 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e20d64-fab6-4966-a15a-e5648fb60c66 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:38.855170 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855061-8475-4737-96dc-26a8e85ee72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:38.855826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855061-8475-4737-96dc-26a8e85ee72f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:38.856103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855061-8475-4737-96dc-26a8e85ee72f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:38.856374 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855061-8475-4737-96dc-26a8e85ee72f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:38.871089 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:38.905326 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef6425-7831-41ca-946c-2c6111df2236 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:38.939213 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4855061-8475-4737-96dc-26a8e85ee72f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:38.940969 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4855061-8475-4737-96dc-26a8e85ee72f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:38.954337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:38.976890 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:38.977498 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:38.977771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:38.978037 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:38.978760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=afad98494253442ca485960bb1d083df, user.id=7424d27f71b74dc5abbe1b92089f887c) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:38.979061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:38.980549 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:38.993132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 92/183] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:38 2022] GET /identity/v3/role_assignments?user.id=7424d27f71b74dc5abbe1b92089f887c&scope.project.id=afad98494253442ca485960bb1d083df&role.id=78ddf427bf274205867c7492aec1f590 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:39.079653 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 92/184] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:39.085602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:39.216060 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c5a3-95d8-4e6f-b652-f881a8d6c393 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:39.262643 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514efd03-9a64-4168-bb00-386c3607c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:39.263704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514efd03-9a64-4168-bb00-386c3607c65d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:39.264231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514efd03-9a64-4168-bb00-386c3607c65d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:39.264707 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514efd03-9a64-4168-bb00-386c3607c65d None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:39.268116 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514efd03-9a64-4168-bb00-386c3607c65d None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:39.269600 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514efd03-9a64-4168-bb00-386c3607c65d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:39.272434 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 93/185] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:39 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:39.279490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855061-8475-4737-96dc-26a8e85ee72f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:39.337653 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:39.397412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855061-8475-4737-96dc-26a8e85ee72f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:39.435812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58bbcc-01d6-43bf-947c-663100d5dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:39.437195 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58bbcc-01d6-43bf-947c-663100d5dd2a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:39.437670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58bbcc-01d6-43bf-947c-663100d5dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:39.438136 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58bbcc-01d6-43bf-947c-663100d5dd2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:39.439112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58bbcc-01d6-43bf-947c-663100d5dd2a None admin] RBAC: Adding query filter params (role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6, scope.project.id=afad98494253442ca485960bb1d083df, user.id=7424d27f71b74dc5abbe1b92089f887c) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:39.439676 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58bbcc-01d6-43bf-947c-663100d5dd2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:39.441407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58bbcc-01d6-43bf-947c-663100d5dd2a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:39.450987 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 93/186] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:39 2022] GET /identity/v3/role_assignments?user.id=7424d27f71b74dc5abbe1b92089f887c&scope.project.id=afad98494253442ca485960bb1d083df&role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:39.840669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340e5c8-83a7-422b-bbe0-fc3110688fbf None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:39.841195 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340e5c8-83a7-422b-bbe0-fc3110688fbf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:39.841195 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340e5c8-83a7-422b-bbe0-fc3110688fbf None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:39.842665 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 94/187] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:39.844513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf5f7b-4f6b-4eea-8f76-615d7174bad7 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:39.844804 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf5f7b-4f6b-4eea-8f76-615d7174bad7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:39.845078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf5f7b-4f6b-4eea-8f76-615d7174bad7 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:39.846723 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 94/188] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:39.847843 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d099-297e-4282-b179-f0de2cc14108 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:39.848139 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d099-297e-4282-b179-f0de2cc14108 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:39.848413 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d099-297e-4282-b179-f0de2cc14108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:39.851756 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961472-c2c4-4613-9298-003c24c9fcbe None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:39.852038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961472-c2c4-4613-9298-003c24c9fcbe None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:39.852312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961472-c2c4-4613-9298-003c24c9fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:39.869588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ebd7d099-297e-4282-b179-f0de2cc14108 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:39.870528 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c2961472-c2c4-4613-9298-003c24c9fcbe None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:39.870774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ebd7d099-297e-4282-b179-f0de2cc14108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:39.871737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c2961472-c2c4-4613-9298-003c24c9fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:39.926041 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:39.941402 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 95/189] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:39.949843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 95/190] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:40.211922 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d099-297e-4282-b179-f0de2cc14108 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:40.220198 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961472-c2c4-4613-9298-003c24c9fcbe None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:40.255318 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:40.311854 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d099-297e-4282-b179-f0de2cc14108 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:40.321008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2961472-c2c4-4613-9298-003c24c9fcbe None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:40.344793 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827d21-6169-4b62-8764-db6fd25b3b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:40.345413 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827d21-6169-4b62-8764-db6fd25b3b2c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:40.345683 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827d21-6169-4b62-8764-db6fd25b3b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:40.345954 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827d21-6169-4b62-8764-db6fd25b3b2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:40.355218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041b033-e23e-478c-b938-ae4acd9180f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:40.355858 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041b033-e23e-478c-b938-ae4acd9180f5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:40.356130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041b033-e23e-478c-b938-ae4acd9180f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:40.356221 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2827d21-6169-4b62-8764-db6fd25b3b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:40.356396 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041b033-e23e-478c-b938-ae4acd9180f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:40.357466 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041b033-e23e-478c-b938-ae4acd9180f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:40.358895 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041b033-e23e-478c-b938-ae4acd9180f5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:40.360477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b2827d21-6169-4b62-8764-db6fd25b3b2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:40.361704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:40.362515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:40.363325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:40.363944 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690c13f-7405-4eb6-a267-0c17a5da9856 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:40.363944 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690c13f-7405-4eb6-a267-0c17a5da9856 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:40.364078 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 96/192] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:40.364149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690c13f-7405-4eb6-a267-0c17a5da9856 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:40.364149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 97/193] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:40.367742 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827d21-6169-4b62-8764-db6fd25b3b2c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:40.368153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690c13f-7405-4eb6-a267-0c17a5da9856 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:40.416734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:40.467162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827d21-6169-4b62-8764-db6fd25b3b2c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:40.468357 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690c13f-7405-4eb6-a267-0c17a5da9856 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:40.470619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:40.502683 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fed2b-debb-4479-850a-f7c7e22e90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:40.503311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fed2b-debb-4479-850a-f7c7e22e90fa None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:40.503591 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fed2b-debb-4479-850a-f7c7e22e90fa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:40.503858 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fed2b-debb-4479-850a-f7c7e22e90fa None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:40.504155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23372f21-2f01-4b94-bcc4-2b47dc238a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:40.504496 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fed2b-debb-4479-850a-f7c7e22e90fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:40.505021 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372f21-2f01-4b94-bcc4-2b47dc238a2e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:40.505488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372f21-2f01-4b94-bcc4-2b47dc238a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:40.505981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372f21-2f01-4b94-bcc4-2b47dc238a2e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:40.506245 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fed2b-debb-4479-850a-f7c7e22e90fa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:40.506497 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23372f21-2f01-4b94-bcc4-2b47dc238a2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:40.506794 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23372f21-2f01-4b94-bcc4-2b47dc238a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:40.508174 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23372f21-2f01-4b94-bcc4-2b47dc238a2e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:40.516228 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:40.517455 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101770d3-1c30-4e20-86d8-0417816e05ba None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:40.517780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101770d3-1c30-4e20-86d8-0417816e05ba None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:40.518098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101770d3-1c30-4e20-86d8-0417816e05ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:40.530651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 97/195] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:27:40 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:40.536340 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fed2b-debb-4479-850a-f7c7e22e90fa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:40.540159 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-101770d3-1c30-4e20-86d8-0417816e05ba None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:40.541364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-101770d3-1c30-4e20-86d8-0417816e05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:40.623717 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 99/196] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:40.651718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fed2b-debb-4479-850a-f7c7e22e90fa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:40.655073 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:40.691378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfe59e-c913-4a2e-a8b2-f6c5380d21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:40.692019 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfe59e-c913-4a2e-a8b2-f6c5380d21ab None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:40.692294 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfe59e-c913-4a2e-a8b2-f6c5380d21ab None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:40.692647 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfe59e-c913-4a2e-a8b2-f6c5380d21ab None admin] PATH_INFO: `/v3/users/94afda01796e4185997d11458e70c350` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:40.708797 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfe59e-c913-4a2e-a8b2-f6c5380d21ab None admin] RBAC: Authorizing `identity:get_user(user_id=94afda01796e4185997d11458e70c350)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:40.710699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfe59e-c913-4a2e-a8b2-f6c5380d21ab None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:40.712671 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 98/197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:40 2022] GET /identity/v3/users/94afda01796e4185997d11458e70c350 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:40.718737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101770d3-1c30-4e20-86d8-0417816e05ba None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:40.820274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:40.829186 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101770d3-1c30-4e20-86d8-0417816e05ba None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:40.869441 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d98d47-7962-46c8-aab1-4a0badb7d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:40.870129 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d98d47-7962-46c8-aab1-4a0badb7d250 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:40.870359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d98d47-7962-46c8-aab1-4a0badb7d250 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:40.870631 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d98d47-7962-46c8-aab1-4a0badb7d250 None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:40.871785 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d98d47-7962-46c8-aab1-4a0badb7d250 None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:40.873243 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d98d47-7962-46c8-aab1-4a0badb7d250 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:40.875039 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 100/198] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:40 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:40.881688 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfe59e-c913-4a2e-a8b2-f6c5380d21ab None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:40.916095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d98d47-7962-46c8-aab1-4a0badb7d250 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:41.003873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfe59e-c913-4a2e-a8b2-f6c5380d21ab None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:41.029719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d98d47-7962-46c8-aab1-4a0badb7d250 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:41.051380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50def1a-6d7e-4eae-9fb6-3997acce3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:41.052576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50def1a-6d7e-4eae-9fb6-3997acce3c28 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:41.053500 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50def1a-6d7e-4eae-9fb6-3997acce3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:41.053778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50def1a-6d7e-4eae-9fb6-3997acce3c28 None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df/users/94afda01796e4185997d11458e70c350/roles/07e01b6649654a428718e8c9400f41b1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:41.056757 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50def1a-6d7e-4eae-9fb6-3997acce3c28 None admin] RBAC: Authorizing `identity:create_grant(project_id=afad98494253442ca485960bb1d083df, user_id=94afda01796e4185997d11458e70c350, role_id=07e01b6649654a428718e8c9400f41b1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:41.058474 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50def1a-6d7e-4eae-9fb6-3997acce3c28 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:41.070887 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5583de-c796-4570-91b5-046e953380fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:41.072141 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5583de-c796-4570-91b5-046e953380fd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:41.072710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5583de-c796-4570-91b5-046e953380fd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:41.073411 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5583de-c796-4570-91b5-046e953380fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:41.076925 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 99/199] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:27:40 2022] PUT /identity/v3/projects/afad98494253442ca485960bb1d083df/users/94afda01796e4185997d11458e70c350/roles/07e01b6649654a428718e8c9400f41b1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:27:41.092665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5583de-c796-4570-91b5-046e953380fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fa5583de-c796-4570-91b5-046e953380fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:41.098812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:41.100647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:41.101648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:41.103993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 101/200] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:41.113019 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50def1a-6d7e-4eae-9fb6-3997acce3c28 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:41.176763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:41.237829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50def1a-6d7e-4eae-9fb6-3997acce3c28 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:41.280830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:41.281456 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:41.281795 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:41.282133 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:41.282859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:41.283227 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:41.284814 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:41.294826 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 100/201] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:41.300535 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5583de-c796-4570-91b5-046e953380fd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:41.329141 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:41.414898 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5583de-c796-4570-91b5-046e953380fd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:41.455977 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f22b-1bd6-4f00-9672-16e01333da8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:41.456860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f22b-1bd6-4f00-9672-16e01333da8d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:41.457313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f22b-1bd6-4f00-9672-16e01333da8d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:41.457718 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f22b-1bd6-4f00-9672-16e01333da8d None admin] PATH_INFO: `/v3/users/b7dadc16072b458eb90fcef8af83a049` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:41.459057 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f22b-1bd6-4f00-9672-16e01333da8d None admin] RBAC: Authorizing `identity:get_user(user_id=b7dadc16072b458eb90fcef8af83a049)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:41.460672 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f22b-1bd6-4f00-9672-16e01333da8d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:41.462706 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:41 2022] GET /identity/v3/users/b7dadc16072b458eb90fcef8af83a049 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:41.468149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:41.569092 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:41.585659 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c86c7-e286-4165-a158-24d717e26e36 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:41.625401 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86107288-a7b4-4351-bdfb-85daf06bf7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:41.626244 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107288-a7b4-4351-bdfb-85daf06bf7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:41.626682 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107288-a7b4-4351-bdfb-85daf06bf7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:41.627086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107288-a7b4-4351-bdfb-85daf06bf7b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:41.704576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86107288-a7b4-4351-bdfb-85daf06bf7b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:41.706124 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86107288-a7b4-4351-bdfb-85daf06bf7b7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:41.799687 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:41.819970 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 101/203] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:41.825672 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f22b-1bd6-4f00-9672-16e01333da8d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:41.924403 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:41.935685 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f22b-1bd6-4f00-9672-16e01333da8d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:41.972401 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494d410-d4b7-4f6b-92bc-2e1960a51d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:41.973006 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494d410-d4b7-4f6b-92bc-2e1960a51d1d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:41.973283 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494d410-d4b7-4f6b-92bc-2e1960a51d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:41.973556 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494d410-d4b7-4f6b-92bc-2e1960a51d1d None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:41.974720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494d410-d4b7-4f6b-92bc-2e1960a51d1d None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:41.976238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494d410-d4b7-4f6b-92bc-2e1960a51d1d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:41.978181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 103/204] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:41 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:41.984411 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86107288-a7b4-4351-bdfb-85daf06bf7b7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:42.094193 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86107288-a7b4-4351-bdfb-85daf06bf7b7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:42.129505 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f5575-9330-4c38-b3c6-9dbda0a713e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:42.130908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5575-9330-4c38-b3c6-9dbda0a713e4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:42.131182 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5575-9330-4c38-b3c6-9dbda0a713e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:42.131556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f5575-9330-4c38-b3c6-9dbda0a713e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:42.132280 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f5575-9330-4c38-b3c6-9dbda0a713e4 None admin] RBAC: Adding query filter params (role.id=9e0338b743904d8ea8d77f7cea397655, scope.project.id=afad98494253442ca485960bb1d083df, user.id=b7dadc16072b458eb90fcef8af83a049) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:42.132585 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f5575-9330-4c38-b3c6-9dbda0a713e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:42.134023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f5575-9330-4c38-b3c6-9dbda0a713e4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:42.139970 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 102/205] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:41 2022] GET /identity/v3/role_assignments?user.id=b7dadc16072b458eb90fcef8af83a049&scope.project.id=afad98494253442ca485960bb1d083df&role.id=9e0338b743904d8ea8d77f7cea397655 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:42.887920 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86257-d932-4519-88f5-b41fc0b23edb None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:42.888425 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86257-d932-4519-88f5-b41fc0b23edb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:42.888496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86257-d932-4519-88f5-b41fc0b23edb None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:42.889944 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 104/206] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:42.894964 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab46d4-bffa-4e16-807f-69c2008e52b6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:42.895273 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab46d4-bffa-4e16-807f-69c2008e52b6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:42.895557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab46d4-bffa-4e16-807f-69c2008e52b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:42.914789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8dab46d4-bffa-4e16-807f-69c2008e52b6 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:42.915994 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8dab46d4-bffa-4e16-807f-69c2008e52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:42.961637 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:42.966075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36c076-23fc-4405-a672-51c05c7763bf None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:42.966354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36c076-23fc-4405-a672-51c05c7763bf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:42.966624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36c076-23fc-4405-a672-51c05c7763bf None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:42.968128 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 105/207] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:42.972986 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b70ec-8ca0-4000-bd87-f7cd6e92f720 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:42.973268 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b70ec-8ca0-4000-bd87-f7cd6e92f720 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:42.973544 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b70ec-8ca0-4000-bd87-f7cd6e92f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:42.989120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 103/208] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:42.994522 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bf7b70ec-8ca0-4000-bd87-f7cd6e92f720 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:42.995831 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bf7b70ec-8ca0-4000-bd87-f7cd6e92f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:43.062338 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 106/209] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:43.262915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab46d4-bffa-4e16-807f-69c2008e52b6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:43.331938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b70ec-8ca0-4000-bd87-f7cd6e92f720 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:43.365165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab46d4-bffa-4e16-807f-69c2008e52b6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:43.400580 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2ad35-3efe-4740-aa22-9d34111c14ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:43.401198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2ad35-3efe-4740-aa22-9d34111c14ac None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:43.401467 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2ad35-3efe-4740-aa22-9d34111c14ac None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:43.401732 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2ad35-3efe-4740-aa22-9d34111c14ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:43.411556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2ad35-3efe-4740-aa22-9d34111c14ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e7e2ad35-3efe-4740-aa22-9d34111c14ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:43.416348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:43.417353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:43.418261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 104/210] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:43.418896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503707-cace-4fee-bd4d-48ab14e4907b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:43.418896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503707-cace-4fee-bd4d-48ab14e4907b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:43.419067 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34503707-cace-4fee-bd4d-48ab14e4907b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:43.420443 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 105/211] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:43.423380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503707-cace-4fee-bd4d-48ab14e4907b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:43.425665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:43.436242 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b70ec-8ca0-4000-bd87-f7cd6e92f720 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:43.468900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:43.472241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e20e6-eefe-4a73-8048-7bdc9f7d5388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:43.472869 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e20e6-eefe-4a73-8048-7bdc9f7d5388 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:43.473136 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e20e6-eefe-4a73-8048-7bdc9f7d5388 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:43.473415 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e20e6-eefe-4a73-8048-7bdc9f7d5388 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:43.474567 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e20e6-eefe-4a73-8048-7bdc9f7d5388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:43.476033 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e20e6-eefe-4a73-8048-7bdc9f7d5388 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:43.477589 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 107/212] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:43.483530 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954432b1-93a3-456e-8879-d0aa133c1dd0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:43.483818 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954432b1-93a3-456e-8879-d0aa133c1dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:43.484098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954432b1-93a3-456e-8879-d0aa133c1dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:43.502948 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-954432b1-93a3-456e-8879-d0aa133c1dd0 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:43.504165 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-954432b1-93a3-456e-8879-d0aa133c1dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:43.530827 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34503707-cace-4fee-bd4d-48ab14e4907b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:43.564137 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:43.564938 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:43.565215 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:43.565483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:43.566143 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:43.566440 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:43.568480 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:43.572084 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 108/213] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:43.572888 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954432b1-93a3-456e-8879-d0aa133c1dd0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:43.576524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:43.582133 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:43.666015 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:43.681135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954432b1-93a3-456e-8879-d0aa133c1dd0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:43.681632 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:43.684990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230e679-912e-4458-9a18-8845dfb4294c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:43.716469 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c200041-23e4-4048-bc02-ffc2c053f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:43.717152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200041-23e4-4048-bc02-ffc2c053f1cb None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:43.717355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200041-23e4-4048-bc02-ffc2c053f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:43.717624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200041-23e4-4048-bc02-ffc2c053f1cb None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:43.718340 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c200041-23e4-4048-bc02-ffc2c053f1cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:43.719749 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c200041-23e4-4048-bc02-ffc2c053f1cb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:43.726225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a06d2-bb9d-4338-abcd-facb731f7c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:43.726851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a06d2-bb9d-4338-abcd-facb731f7c6c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:43.727124 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a06d2-bb9d-4338-abcd-facb731f7c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:43.727423 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a06d2-bb9d-4338-abcd-facb731f7c6c None admin] PATH_INFO: `/v3/users/d4d391407c854dd7946cb4879c57c13f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:43.743216 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a06d2-bb9d-4338-abcd-facb731f7c6c None admin] RBAC: Authorizing `identity:get_user(user_id=d4d391407c854dd7946cb4879c57c13f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:43.743770 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 109/215] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:27:43 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:43.744698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a06d2-bb9d-4338-abcd-facb731f7c6c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:43.746459 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 107/216] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:43 2022] GET /identity/v3/users/d4d391407c854dd7946cb4879c57c13f => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:43.752448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c200041-23e4-4048-bc02-ffc2c053f1cb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:43.844225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a06d2-bb9d-4338-abcd-facb731f7c6c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:43.875759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c200041-23e4-4048-bc02-ffc2c053f1cb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:43.915716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:43.916357 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:43.916585 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:43.916853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:43.917575 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] RBAC: Adding query filter params (role.id=9e0338b743904d8ea8d77f7cea397655, user.id=d4d391407c854dd7946cb4879c57c13f, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:43.917873 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:43.919357 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:43.925274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 110/217] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Oct 18 11:27:43 2022] GET /identity/v3/role_assignments?user.id=d4d391407c854dd7946cb4879c57c13f&scope.system=all&role.id=9e0338b743904d8ea8d77f7cea397655 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:43.973175 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a06d2-bb9d-4338-abcd-facb731f7c6c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:44.015768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84825a-d54b-45da-93c9-78fb3b66b717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:44.016433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84825a-d54b-45da-93c9-78fb3b66b717 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:44.016674 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84825a-d54b-45da-93c9-78fb3b66b717 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:44.016941 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84825a-d54b-45da-93c9-78fb3b66b717 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:44.030405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84825a-d54b-45da-93c9-78fb3b66b717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3f84825a-d54b-45da-93c9-78fb3b66b717 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:44.035458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:44.036430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:44.037483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 108/218] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:44.042957 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:44.062163 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:44.166169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7a13e-c648-47ec-b4e7-20c037f03f74 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:44.206458 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:44.207064 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:44.207366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:44.207635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:44.208383 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:44.208684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:44.210258 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:44.219176 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 111/219] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:44.225095 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84825a-d54b-45da-93c9-78fb3b66b717 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:44.245322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:44.334172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84825a-d54b-45da-93c9-78fb3b66b717 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:44.369907 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7d0e1-efc9-489c-a93b-4363c0f90c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:44.370777 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7d0e1-efc9-489c-a93b-4363c0f90c5b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:44.371201 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7d0e1-efc9-489c-a93b-4363c0f90c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:44.371642 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7d0e1-efc9-489c-a93b-4363c0f90c5b None admin] PATH_INFO: `/v3/users/94afda01796e4185997d11458e70c350` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:44.372924 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7d0e1-efc9-489c-a93b-4363c0f90c5b None admin] RBAC: Authorizing `identity:get_user(user_id=94afda01796e4185997d11458e70c350)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:44.374529 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7d0e1-efc9-489c-a93b-4363c0f90c5b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:44.376286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 109/220] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:44 2022] GET /identity/v3/users/94afda01796e4185997d11458e70c350 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:44.382779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:44.462025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:44.496529 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd049ee-450e-42be-9b21-63f7420a5356 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:44.532181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b953ff1-5e5c-4121-8e50-f97596d916d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:44.532795 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953ff1-5e5c-4121-8e50-f97596d916d1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:44.533075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953ff1-5e5c-4121-8e50-f97596d916d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:44.533350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b953ff1-5e5c-4121-8e50-f97596d916d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:44.604412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b953ff1-5e5c-4121-8e50-f97596d916d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:44.605957 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b953ff1-5e5c-4121-8e50-f97596d916d1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:44.678203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:44.712696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 112/221] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:44.718473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7d0e1-efc9-489c-a93b-4363c0f90c5b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:44.809376 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:44.829204 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7d0e1-efc9-489c-a93b-4363c0f90c5b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:44.871510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26b1ad-f815-4c9c-b7e4-a803f85a8efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:44.872198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b1ad-f815-4c9c-b7e4-a803f85a8efd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:44.872409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b1ad-f815-4c9c-b7e4-a803f85a8efd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:44.872672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26b1ad-f815-4c9c-b7e4-a803f85a8efd None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:44.873807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26b1ad-f815-4c9c-b7e4-a803f85a8efd None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:44.875239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26b1ad-f815-4c9c-b7e4-a803f85a8efd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:44.876901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 110/222] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:44 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:44.883329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b953ff1-5e5c-4121-8e50-f97596d916d1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:44.988943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b953ff1-5e5c-4121-8e50-f97596d916d1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:45.025832 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc184d89-2fa9-4c3f-a12a-1b4432909d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:45.026434 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184d89-2fa9-4c3f-a12a-1b4432909d69 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:45.026711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184d89-2fa9-4c3f-a12a-1b4432909d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:45.026983 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc184d89-2fa9-4c3f-a12a-1b4432909d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:45.027752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc184d89-2fa9-4c3f-a12a-1b4432909d69 None admin] RBAC: Adding query filter params (role.id=07e01b6649654a428718e8c9400f41b1, scope.project.id=afad98494253442ca485960bb1d083df, user.id=94afda01796e4185997d11458e70c350) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:45.028057 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc184d89-2fa9-4c3f-a12a-1b4432909d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:45.029496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc184d89-2fa9-4c3f-a12a-1b4432909d69 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:45.035401 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 113/223] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:27:44 2022] GET /identity/v3/role_assignments?user.id=94afda01796e4185997d11458e70c350&scope.project.id=afad98494253442ca485960bb1d083df&role.id=07e01b6649654a428718e8c9400f41b1 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:46.162150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc298a9-a9e9-4a39-b314-312260492d11 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.162807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc298a9-a9e9-4a39-b314-312260492d11 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.162807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc298a9-a9e9-4a39-b314-312260492d11 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.164325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 111/224] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:46.170269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f82d23-54ce-43e2-acb6-d0b3008d08cd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.170784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f82d23-54ce-43e2-acb6-d0b3008d08cd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.170784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f82d23-54ce-43e2-acb6-d0b3008d08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.173569 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e0ec3-fbac-4297-8b2a-768970e3f7ce None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.173847 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e0ec3-fbac-4297-8b2a-768970e3f7ce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.174120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e0ec3-fbac-4297-8b2a-768970e3f7ce None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.175982 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 112/225] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:27:46.182099 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794a2a-bc3d-4905-b363-dae75394a746 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.182462 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794a2a-bc3d-4905-b363-dae75394a746 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.182651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794a2a-bc3d-4905-b363-dae75394a746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.192072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d0f82d23-54ce-43e2-acb6-d0b3008d08cd None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:46.193595 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d0f82d23-54ce-43e2-acb6-d0b3008d08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:46.201488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fb794a2a-bc3d-4905-b363-dae75394a746 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:46.202633 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fb794a2a-bc3d-4905-b363-dae75394a746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:46.222225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:46.266664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 114/226] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:46.268546 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e740f7a-ecc7-4535-93da-370520039c2b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.268834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e740f7a-ecc7-4535-93da-370520039c2b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.269112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e740f7a-ecc7-4535-93da-370520039c2b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.270366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 115/227] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:46.275542 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ac24-f378-41de-a651-f5e36d552107 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.275822 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ac24-f378-41de-a651-f5e36d552107 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.276096 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8ac24-f378-41de-a651-f5e36d552107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.276496 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 113/228] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:46.296854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-93d8ac24-f378-41de-a651-f5e36d552107 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:46.298223 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-93d8ac24-f378-41de-a651-f5e36d552107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:46.363929 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 116/229] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:46.547124 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb794a2a-bc3d-4905-b363-dae75394a746 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:46.548553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8ac24-f378-41de-a651-f5e36d552107 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:46.631825 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:46.646495 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:46.648710 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb794a2a-bc3d-4905-b363-dae75394a746 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:46.657112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8ac24-f378-41de-a651-f5e36d552107 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:46.682689 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1b04c-6baa-4615-8582-e55e1a80d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:46.683328 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1b04c-6baa-4615-8582-e55e1a80d269 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.683602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1b04c-6baa-4615-8582-e55e1a80d269 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.683874 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1b04c-6baa-4615-8582-e55e1a80d269 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.684962 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1b04c-6baa-4615-8582-e55e1a80d269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:46.686378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1b04c-6baa-4615-8582-e55e1a80d269 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:46.687961 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:46.693419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1b04c-6baa-4615-8582-e55e1a80d269 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:46.693525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288221-f4d0-4b89-a75a-6ebb9d90a4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:46.693821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288221-f4d0-4b89-a75a-6ebb9d90a4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.694100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288221-f4d0-4b89-a75a-6ebb9d90a4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.694374 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288221-f4d0-4b89-a75a-6ebb9d90a4a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.704574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a288221-f4d0-4b89-a75a-6ebb9d90a4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6a288221-f4d0-4b89-a75a-6ebb9d90a4a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:46.710152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:46.711203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:46.712040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 117/231] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:46.712687 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288221-f4d0-4b89-a75a-6ebb9d90a4a3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:46.792343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1b04c-6baa-4615-8582-e55e1a80d269 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:46.813988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288221-f4d0-4b89-a75a-6ebb9d90a4a3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:46.825405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a51c-a259-47a9-a828-f6f473845101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:46.826037 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a51c-a259-47a9-a828-f6f473845101 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.826315 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a51c-a259-47a9-a828-f6f473845101 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.827035 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183a51c-a259-47a9-a828-f6f473845101 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.840964 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183a51c-a259-47a9-a828-f6f473845101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7183a51c-a259-47a9-a828-f6f473845101 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:46.845784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:46.846657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:46.847478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 115/232] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:46.848130 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a51c-a259-47a9-a828-f6f473845101 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:46.852147 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aadbc-8ed7-4864-b0dd-a76b160242b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:46.852806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aadbc-8ed7-4864-b0dd-a76b160242b3 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:46.853118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aadbc-8ed7-4864-b0dd-a76b160242b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:46.853387 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aadbc-8ed7-4864-b0dd-a76b160242b3 None admin] PATH_INFO: `/v3/groups` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:46.854002 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aadbc-8ed7-4864-b0dd-a76b160242b3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:46.855476 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aadbc-8ed7-4864-b0dd-a76b160242b3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:46.866699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:46.871669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 118/233] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Oct 18 11:27:46 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:46.872539 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aadbc-8ed7-4864-b0dd-a76b160242b3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:46.905533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:46.967849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183a51c-a259-47a9-a828-f6f473845101 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:47.001211 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aadbc-8ed7-4864-b0dd-a76b160242b3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:47.006039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:47.006670 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:47.006946 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:47.007215 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:47.007922 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:47.008224 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:47.009631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:47.018761 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 116/234] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:47.025232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:47.040285 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:47.040907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:47.041187 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:47.041459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:47.042130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:47.042484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:47.043859 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:47.053741 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 119/235] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:47.060149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:47.114955 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:47.142290 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:47.145281 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a113-82d1-4c93-a038-7f70002a236c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:47.167594 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949aae-7c96-43b8-9a9f-ce523b413831 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:47.188920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a6f05-38a1-4c7b-8ecf-2d73308d27e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:47.189641 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a6f05-38a1-4c7b-8ecf-2d73308d27e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:47.189945 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a6f05-38a1-4c7b-8ecf-2d73308d27e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:47.190207 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a6f05-38a1-4c7b-8ecf-2d73308d27e6 None admin] PATH_INFO: `/v3/users/48f92d0788894e4c8eb8847acd68d27f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:47.203118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afa04b-93d7-49ed-8777-7842f159c6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:47.203786 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa04b-93d7-49ed-8777-7842f159c6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:47.204062 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa04b-93d7-49ed-8777-7842f159c6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:47.204330 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa04b-93d7-49ed-8777-7842f159c6a2 None admin] PATH_INFO: `/v3/users/d4d391407c854dd7946cb4879c57c13f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:47.205350 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a6f05-38a1-4c7b-8ecf-2d73308d27e6 None admin] RBAC: Authorizing `identity:get_user(user_id=48f92d0788894e4c8eb8847acd68d27f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:47.205453 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afa04b-93d7-49ed-8777-7842f159c6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=d4d391407c854dd7946cb4879c57c13f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:47.206850 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afa04b-93d7-49ed-8777-7842f159c6a2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:47.206950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a6f05-38a1-4c7b-8ecf-2d73308d27e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:47.209407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 120/236] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:47 2022] GET /identity/v3/users/d4d391407c854dd7946cb4879c57c13f => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:47.209743 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 117/237] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:47 2022] GET /identity/v3/users/48f92d0788894e4c8eb8847acd68d27f => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:47.214658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afa04b-93d7-49ed-8777-7842f159c6a2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:47.219108 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a6f05-38a1-4c7b-8ecf-2d73308d27e6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:47.322865 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afa04b-93d7-49ed-8777-7842f159c6a2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:47.327318 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a6f05-38a1-4c7b-8ecf-2d73308d27e6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:47.357710 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:47.361620 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9fdea-1351-490e-8d54-2261eeb9cfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:47.362272 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9fdea-1351-490e-8d54-2261eeb9cfe0 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:47.362580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9fdea-1351-490e-8d54-2261eeb9cfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:47.362850 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9fdea-1351-490e-8d54-2261eeb9cfe0 None admin] PATH_INFO: `/v3/system/users/d4d391407c854dd7946cb4879c57c13f/roles/9e0338b743904d8ea8d77f7cea397655` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:47.363485 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6528f74-a1e9-4d17-9ee6-000866e2b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:47.365178 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6528f74-a1e9-4d17-9ee6-000866e2b5dd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:47.365320 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9fdea-1351-490e-8d54-2261eeb9cfe0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d4d391407c854dd7946cb4879c57c13f, role_id=9e0338b743904d8ea8d77f7cea397655)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:47.365852 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6528f74-a1e9-4d17-9ee6-000866e2b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:47.366268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6528f74-a1e9-4d17-9ee6-000866e2b5dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:47.366955 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9fdea-1351-490e-8d54-2261eeb9cfe0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:47.367311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6528f74-a1e9-4d17-9ee6-000866e2b5dd None admin] RBAC: Adding query filter params (role.id=07e01b6649654a428718e8c9400f41b1, user.id=48f92d0788894e4c8eb8847acd68d27f, scope.system=all) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:47.367846 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6528f74-a1e9-4d17-9ee6-000866e2b5dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:47.369410 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6528f74-a1e9-4d17-9ee6-000866e2b5dd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:47.375684 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 118/238] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Oct 18 11:27:47 2022] GET /identity/v3/role_assignments?user.id=48f92d0788894e4c8eb8847acd68d27f&scope.system=all&role.id=07e01b6649654a428718e8c9400f41b1 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:47.382779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 121/239] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Oct 18 11:27:47 2022] PUT /identity/v3/system/users/d4d391407c854dd7946cb4879c57c13f/roles/9e0338b743904d8ea8d77f7cea397655 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:27:49.080510 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182225-6ff3-46a1-9ecd-7f76aa6e545c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:49.081094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182225-6ff3-46a1-9ecd-7f76aa6e545c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:49.081094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9182225-6ff3-46a1-9ecd-7f76aa6e545c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:49.082468 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 122/240] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:49.087932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610bcab-4567-45fe-b1b2-ac83afa5b51a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:49.088347 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610bcab-4567-45fe-b1b2-ac83afa5b51a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:49.088508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610bcab-4567-45fe-b1b2-ac83afa5b51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:49.106482 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e610bcab-4567-45fe-b1b2-ac83afa5b51a None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:49.107681 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e610bcab-4567-45fe-b1b2-ac83afa5b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:49.180277 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 119/241] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:49.447740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182225-6ff3-46a1-9ecd-7f76aa6e545c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:49.461663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:49.544276 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bb04-a7de-4ed9-96ef-8750a0e1619c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:49.544556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bb04-a7de-4ed9-96ef-8750a0e1619c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:49.544857 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4bb04-a7de-4ed9-96ef-8750a0e1619c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:49.546199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 120/242] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:27:49.552924 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145a75-86c9-4f7d-9a8b-f103efc45e6e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:49.553201 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145a75-86c9-4f7d-9a8b-f103efc45e6e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:49.553473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52145a75-86c9-4f7d-9a8b-f103efc45e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:49.567702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9182225-6ff3-46a1-9ecd-7f76aa6e545c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:49.570879 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-52145a75-86c9-4f7d-9a8b-f103efc45e6e None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:49.572348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-52145a75-86c9-4f7d-9a8b-f103efc45e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:49.601777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117130-8c3c-4840-92ae-98d69e5b361d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:49.602401 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117130-8c3c-4840-92ae-98d69e5b361d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:49.602679 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117130-8c3c-4840-92ae-98d69e5b361d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:49.602949 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117130-8c3c-4840-92ae-98d69e5b361d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:49.604072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6117130-8c3c-4840-92ae-98d69e5b361d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:49.605516 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6117130-8c3c-4840-92ae-98d69e5b361d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:49.607073 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 123/243] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:27:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:49.612485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd393e-6edb-45e4-a484-16e96a6718c3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:49.612765 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd393e-6edb-45e4-a484-16e96a6718c3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:49.613037 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd393e-6edb-45e4-a484-16e96a6718c3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:49.614380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 124/244] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:49.615594 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd393e-6edb-45e4-a484-16e96a6718c3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:49.642052 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 121/245] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:49.645893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41518fc-9294-490b-b471-69c08c53d04f None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:49.645893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41518fc-9294-490b-b471-69c08c53d04f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:49.645893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41518fc-9294-490b-b471-69c08c53d04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:49.663713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f41518fc-9294-490b-b471-69c08c53d04f None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:49.664887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f41518fc-9294-490b-b471-69c08c53d04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:49.705209 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:49.718549 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:49.732660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd393e-6edb-45e4-a484-16e96a6718c3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:49.736692 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 122/246] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:49.766684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a20b5c-a5ac-4d1a-8a06-f3f0ed90a0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:49.767305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20b5c-a5ac-4d1a-8a06-f3f0ed90a0f2 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:49.767580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20b5c-a5ac-4d1a-8a06-f3f0ed90a0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:49.767845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20b5c-a5ac-4d1a-8a06-f3f0ed90a0f2 None admin] PATH_INFO: `/v3/groups` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:49.768462 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a20b5c-a5ac-4d1a-8a06-f3f0ed90a0f2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:49.769884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a20b5c-a5ac-4d1a-8a06-f3f0ed90a0f2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:49.785496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 125/247] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Oct 18 11:27:49 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:27:49.912365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41518fc-9294-490b-b471-69c08c53d04f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:50.007838 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a20b5c-a5ac-4d1a-8a06-f3f0ed90a0f2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:50.022812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41518fc-9294-490b-b471-69c08c53d04f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:50.072282 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc88e86-b26c-4dfb-8142-86e7edc1c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:50.072932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88e86-b26c-4dfb-8142-86e7edc1c926 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:50.073211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88e86-b26c-4dfb-8142-86e7edc1c926 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:50.073536 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc88e86-b26c-4dfb-8142-86e7edc1c926 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:50.085834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc88e86-b26c-4dfb-8142-86e7edc1c926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3cc88e86-b26c-4dfb-8142-86e7edc1c926 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:50.091784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:50.093105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:50.094296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 123/248] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:50.100086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc88e86-b26c-4dfb-8142-86e7edc1c926 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:50.150022 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a20b5c-a5ac-4d1a-8a06-f3f0ed90a0f2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:50.165995 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:50.190200 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7de79-769d-4833-a99d-ee153ab36fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:50.191204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7de79-769d-4833-a99d-ee153ab36fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:50.191723 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7de79-769d-4833-a99d-ee153ab36fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:50.192199 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7de79-769d-4833-a99d-ee153ab36fb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:50.196603 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:50.211089 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7de79-769d-4833-a99d-ee153ab36fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7ca7de79-769d-4833-a99d-ee153ab36fb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:50.216900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:50.217780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:50.218573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:50.220977 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 126/249] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:50.228170 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7de79-769d-4833-a99d-ee153ab36fb5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:50.236840 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc88e86-b26c-4dfb-8142-86e7edc1c926 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:50.277299 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:50.277831 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:50.278112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:50.278381 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:50.279047 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:50.279384 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:50.280749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:50.291143 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 124/250] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:50.295141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:50.348269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7de79-769d-4833-a99d-ee153ab36fb5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:50.386580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:50.387597 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:50.388043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:50.388509 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:50.389335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:50.389820 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:50.391540 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:50.401247 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 127/251] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:50.407209 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:50.410155 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe6aae-ed92-4e6d-9477-8e559f7a3714 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:50.421402 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:50.452343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b6d83-6eca-4ac4-abcc-b1b691be6849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:50.453092 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6d83-6eca-4ac4-abcc-b1b691be6849 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:50.453438 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6d83-6eca-4ac4-abcc-b1b691be6849 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:50.453782 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6d83-6eca-4ac4-abcc-b1b691be6849 None admin] PATH_INFO: `/v3/users/48f92d0788894e4c8eb8847acd68d27f` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:50.454991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b6d83-6eca-4ac4-abcc-b1b691be6849 None admin] RBAC: Authorizing `identity:get_user(user_id=48f92d0788894e4c8eb8847acd68d27f)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:50.456649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b6d83-6eca-4ac4-abcc-b1b691be6849 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:50.459560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 125/252] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:50 2022] GET /identity/v3/users/48f92d0788894e4c8eb8847acd68d27f => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:50.464617 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b6d83-6eca-4ac4-abcc-b1b691be6849 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:50.477730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:50.524065 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1495a-097d-4ca3-8b7b-1333e9e047a2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:50.563173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255ae1-3b74-4ec1-9acc-bbec6bcf400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:50.564153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255ae1-3b74-4ec1-9acc-bbec6bcf400a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:50.564578 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255ae1-3b74-4ec1-9acc-bbec6bcf400a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:50.564993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0255ae1-3b74-4ec1-9acc-bbec6bcf400a None admin] PATH_INFO: `/v3/users/d4d391407c854dd7946cb4879c57c13f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:50.566289 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0255ae1-3b74-4ec1-9acc-bbec6bcf400a None admin] RBAC: Authorizing `identity:get_user(user_id=d4d391407c854dd7946cb4879c57c13f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:50.568519 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0255ae1-3b74-4ec1-9acc-bbec6bcf400a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:50.570748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 128/253] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:50 2022] GET /identity/v3/users/d4d391407c854dd7946cb4879c57c13f => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:50.576673 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255ae1-3b74-4ec1-9acc-bbec6bcf400a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:50.580444 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b6d83-6eca-4ac4-abcc-b1b691be6849 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:50.620746 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d0248-da9a-493f-bcb5-d3cf8264da63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:50.621321 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0248-da9a-493f-bcb5-d3cf8264da63 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:50.621693 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0248-da9a-493f-bcb5-d3cf8264da63 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:50.622055 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d0248-da9a-493f-bcb5-d3cf8264da63 None admin] PATH_INFO: `/v3/system/users/48f92d0788894e4c8eb8847acd68d27f/roles/07e01b6649654a428718e8c9400f41b1` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:50.623672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d0248-da9a-493f-bcb5-d3cf8264da63 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=48f92d0788894e4c8eb8847acd68d27f, role_id=07e01b6649654a428718e8c9400f41b1)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:50.625268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d0248-da9a-493f-bcb5-d3cf8264da63 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:50.635878 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 126/254] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Oct 18 11:27:50 2022] PUT /identity/v3/system/users/48f92d0788894e4c8eb8847acd68d27f/roles/07e01b6649654a428718e8c9400f41b1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:27:50.693823 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0255ae1-3b74-4ec1-9acc-bbec6bcf400a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:50.723863 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:50.733556 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ac2e1-16a1-4ee5-b231-b8b9c9455a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:50.734191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac2e1-16a1-4ee5-b231-b8b9c9455a84 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:50.734468 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac2e1-16a1-4ee5-b231-b8b9c9455a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:50.734742 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac2e1-16a1-4ee5-b231-b8b9c9455a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:50.735568 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ac2e1-16a1-4ee5-b231-b8b9c9455a84 None admin] RBAC: Adding query filter params (role.id=9e0338b743904d8ea8d77f7cea397655, user.id=d4d391407c854dd7946cb4879c57c13f, scope.system=all) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:50.735885 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ac2e1-16a1-4ee5-b231-b8b9c9455a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:50.737434 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ac2e1-16a1-4ee5-b231-b8b9c9455a84 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:50.759663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 129/255] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Oct 18 11:27:50 2022] GET /identity/v3/role_assignments?user.id=d4d391407c854dd7946cb4879c57c13f&scope.system=all&role.id=9e0338b743904d8ea8d77f7cea397655 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:52.368750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc3f2-0302-4518-a625-f8d549e3587f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:52.369254 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc3f2-0302-4518-a625-f8d549e3587f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:52.369328 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc3f2-0302-4518-a625-f8d549e3587f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:52.370877 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 127/256] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:52.385016 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15088b2c-b616-4712-b5c2-b15c8d2891ff None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:52.385451 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15088b2c-b616-4712-b5c2-b15c8d2891ff None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:52.385648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15088b2c-b616-4712-b5c2-b15c8d2891ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:52.412045 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-15088b2c-b616-4712-b5c2-b15c8d2891ff None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:52.413276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-15088b2c-b616-4712-b5c2-b15c8d2891ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:52.491088 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 130/257] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 11:27:52.587566 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203bf3a-c9ef-4f0c-88a5-72f5771032ac None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:52.587886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203bf3a-c9ef-4f0c-88a5-72f5771032ac None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:52.588179 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203bf3a-c9ef-4f0c-88a5-72f5771032ac None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:52.589826 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 128/258] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:52.594845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1f81-5da3-483f-a669-da8707318645 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:52.595134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1f81-5da3-483f-a669-da8707318645 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:52.595439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1f81-5da3-483f-a669-da8707318645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:52.624351 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ecdb1f81-5da3-483f-a669-da8707318645 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:52.625478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ecdb1f81-5da3-483f-a669-da8707318645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:52.634826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 131/259] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 11:27:53.083212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203bf3a-c9ef-4f0c-88a5-72f5771032ac None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.101229 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203bf3a-c9ef-4f0c-88a5-72f5771032ac None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.106379 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175956ef-b442-4053-bf4c-080bb6197826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.107280 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175956ef-b442-4053-bf4c-080bb6197826 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.107750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175956ef-b442-4053-bf4c-080bb6197826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.108210 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175956ef-b442-4053-bf4c-080bb6197826 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.120572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175956ef-b442-4053-bf4c-080bb6197826 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-175956ef-b442-4053-bf4c-080bb6197826 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:53.132887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:53.133832 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:53.134623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:53.137381 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 129/260] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:53.142822 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1f81-5da3-483f-a669-da8707318645 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.144476 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175956ef-b442-4053-bf4c-080bb6197826 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.154590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175956ef-b442-4053-bf4c-080bb6197826 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.162628 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1f81-5da3-483f-a669-da8707318645 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.164300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6212-e536-4382-b741-516b186d6501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.165182 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6212-e536-4382-b741-516b186d6501 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.165647 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6212-e536-4382-b741-516b186d6501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.166133 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6212-e536-4382-b741-516b186d6501 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.179563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6212-e536-4382-b741-516b186d6501 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:53.187331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.187331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.187331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.187331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.187661 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:53.187661 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:53.187950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:27:53.187950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: warnings.warn(msg) Oct 18 11:27:53.187950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: Oct 18 11:27:53.188796 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-912d6212-e536-4382-b741-516b186d6501 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:53.190473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:53.191365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:53.192162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:53.194503 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 130/261] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:53.202589 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 132/262] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:53.208401 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6212-e536-4382-b741-516b186d6501 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.209044 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.219077 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6212-e536-4382-b741-516b186d6501 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.223298 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58268a8-5171-466a-9b74-5f488d16d86f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.232947 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.233944 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.234417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.234879 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] PATH_INFO: `/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.236812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.237424 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.237704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.238110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.238645 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:53.238950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:53.241078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:53.243620 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] RBAC: Authorizing `identity:get_group(group_id=80bf4fe523734c8a8fe9337d48fa3c23)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:53.245589 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:27:53.245589 dv-cinder-815582-17-smb devstack@keystone.service[81703]: warnings.warn(msg) Oct 18 11:27:53.245589 dv-cinder-815582-17-smb devstack@keystone.service[81703]: Oct 18 11:27:53.247118 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:53.253132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 131/263] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:53.256296 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 133/264] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:53.262760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.266105 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.274530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3794b-67e7-4d75-a280-7e77c459b546 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.280921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1727d5-3c8b-4e8e-9fb3-572b1222471f admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.288235 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac28d-f48d-4aa8-9221-29a8ac2fce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.289198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac28d-f48d-4aa8-9221-29a8ac2fce1e admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.289716 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac28d-f48d-4aa8-9221-29a8ac2fce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.290233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac28d-f48d-4aa8-9221-29a8ac2fce1e admin admin] PATH_INFO: `/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.291679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bac28d-f48d-4aa8-9221-29a8ac2fce1e admin admin] RBAC: Authorizing `identity:get_group(group_id=80bf4fe523734c8a8fe9337d48fa3c23)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:53.294038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bac28d-f48d-4aa8-9221-29a8ac2fce1e admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:53.296231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 132/265] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:53.299301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0608d-c0fe-4506-a94f-7487bb63b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.299301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0608d-c0fe-4506-a94f-7487bb63b609 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.299301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0608d-c0fe-4506-a94f-7487bb63b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.299301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0608d-c0fe-4506-a94f-7487bb63b609 admin admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.299903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0608d-c0fe-4506-a94f-7487bb63b609 admin admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:53.302067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba0608d-c0fe-4506-a94f-7487bb63b609 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:53.304033 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 134/266] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:53.312690 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac28d-f48d-4aa8-9221-29a8ac2fce1e admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.313348 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0608d-c0fe-4506-a94f-7487bb63b609 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.320509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:53.326090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0608d-c0fe-4506-a94f-7487bb63b609 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.327462 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac28d-f48d-4aa8-9221-29a8ac2fce1e admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.336326 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec72a7-8f50-46d7-a510-f36e915e5300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.337346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec72a7-8f50-46d7-a510-f36e915e5300 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.337818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec72a7-8f50-46d7-a510-f36e915e5300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.338310 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec72a7-8f50-46d7-a510-f36e915e5300 admin admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.342384 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec72a7-8f50-46d7-a510-f36e915e5300 admin admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:53.345024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec72a7-8f50-46d7-a510-f36e915e5300 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:53.347168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 133/267] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:53.347955 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79487d-fb44-4a27-96bf-10a2c7e26382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.348629 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79487d-fb44-4a27-96bf-10a2c7e26382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.348901 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79487d-fb44-4a27-96bf-10a2c7e26382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.349354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79487d-fb44-4a27-96bf-10a2c7e26382 admin admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b/groups/80bf4fe523734c8a8fe9337d48fa3c23/roles/9e0338b743904d8ea8d77f7cea397655` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.355286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79487d-fb44-4a27-96bf-10a2c7e26382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa83f531a904af69ed3a6154f029a5b, group_id=80bf4fe523734c8a8fe9337d48fa3c23, role_id=9e0338b743904d8ea8d77f7cea397655)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:53.355286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-0e79487d-fb44-4a27-96bf-10a2c7e26382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:27:53.355286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: warnings.warn(msg) Oct 18 11:27:53.355286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: Oct 18 11:27:53.355286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79487d-fb44-4a27-96bf-10a2c7e26382 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:53.364997 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec72a7-8f50-46d7-a510-f36e915e5300 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.378173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec72a7-8f50-46d7-a510-f36e915e5300 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.382435 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 135/268] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 18 11:27:53 2022] PUT /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b/groups/80bf4fe523734c8a8fe9337d48fa3c23/roles/9e0338b743904d8ea8d77f7cea397655 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:53.398700 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c738886-2d0f-4dbb-992e-a90f2ad48a9e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.399362 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c738886-2d0f-4dbb-992e-a90f2ad48a9e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.399362 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c738886-2d0f-4dbb-992e-a90f2ad48a9e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.400980 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 136/269] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:27:53.406729 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2543-5e4c-47bf-bd3b-44db1a8a0b07 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.407013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2543-5e4c-47bf-bd3b-44db1a8a0b07 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.407322 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb2543-5e4c-47bf-bd3b-44db1a8a0b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.443301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-40bb2543-5e4c-47bf-bd3b-44db1a8a0b07 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:53.444518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-40bb2543-5e4c-47bf-bd3b-44db1a8a0b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:53.454443 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553faf3-0b2b-496a-b620-e709ddfe22f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.455434 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553faf3-0b2b-496a-b620-e709ddfe22f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.455910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553faf3-0b2b-496a-b620-e709ddfe22f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.456335 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553faf3-0b2b-496a-b620-e709ddfe22f0 admin admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b/groups/80bf4fe523734c8a8fe9337d48fa3c23/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.459406 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553faf3-0b2b-496a-b620-e709ddfe22f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa83f531a904af69ed3a6154f029a5b, group_id=80bf4fe523734c8a8fe9337d48fa3c23, role_id=bfb1cb6dbfcf40ad9ba6b353b461eea6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:53.460678 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-d553faf3-0b2b-496a-b620-e709ddfe22f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:27:53.460678 dv-cinder-815582-17-smb devstack@keystone.service[81703]: warnings.warn(msg) Oct 18 11:27:53.460678 dv-cinder-815582-17-smb devstack@keystone.service[81703]: Oct 18 11:27:53.462716 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553faf3-0b2b-496a-b620-e709ddfe22f0 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:53.488864 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 134/270] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 18 11:27:53 2022] PUT /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b/groups/80bf4fe523734c8a8fe9337d48fa3c23/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:27:53.490761 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77485-d8ba-4938-97a7-7f26c9338025 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.492820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77485-d8ba-4938-97a7-7f26c9338025 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.493202 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f77485-d8ba-4938-97a7-7f26c9338025 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.495119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 135/271] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:53.503924 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1f74e-1045-4eca-a7d4-3e2b89a14ac5 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.506361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1f74e-1045-4eca-a7d4-3e2b89a14ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.507752 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1f74e-1045-4eca-a7d4-3e2b89a14ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.559080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5cf1f74e-1045-4eca-a7d4-3e2b89a14ac5 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:53.560973 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5cf1f74e-1045-4eca-a7d4-3e2b89a14ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:53.589132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 137/272] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:53.653572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 136/273] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 18 11:27:53.961955 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb2543-5e4c-47bf-bd3b-44db1a8a0b07 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:53.974146 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb2543-5e4c-47bf-bd3b-44db1a8a0b07 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:53.979677 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cf6f4-728f-44ef-933f-9770e2127ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:53.980560 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf6f4-728f-44ef-933f-9770e2127ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:53.981052 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf6f4-728f-44ef-933f-9770e2127ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:53.981536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf6f4-728f-44ef-933f-9770e2127ff3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:53.983319 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1f74e-1045-4eca-a7d4-3e2b89a14ac5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:54.000657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cf6f4-728f-44ef-933f-9770e2127ff3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8e1cf6f4-728f-44ef-933f-9770e2127ff3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:54.006323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:54.007218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:54.008047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 138/274] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:54.029472 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cf6f4-728f-44ef-933f-9770e2127ff3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:54.046374 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cf6f4-728f-44ef-933f-9770e2127ff3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:54.061433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:54.061968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.062241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.062521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.063165 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:54.063486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:54.065262 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:54.071580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:54.083848 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 139/275] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:27:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:54.089842 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:54.095539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:54.110986 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711c140-ec97-4d0c-92a7-91d173ad4dc1 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:54.115371 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1f74e-1045-4eca-a7d4-3e2b89a14ac5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:54.131960 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:54.132611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.132887 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.133154 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] PATH_INFO: `/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.134484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] RBAC: Authorizing `identity:get_group(group_id=80bf4fe523734c8a8fe9337d48fa3c23)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:54.135538 dv-cinder-815582-17-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:27:54.135538 dv-cinder-815582-17-smb devstack@keystone.service[81702]: warnings.warn(msg) Oct 18 11:27:54.135538 dv-cinder-815582-17-smb devstack@keystone.service[81702]: Oct 18 11:27:54.136725 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:54.138610 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 140/276] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 18 11:27:54 2022] GET /identity/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:54.143875 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:54.156884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c76e61-26d9-4a3a-ae7d-41e5e268e8d0 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:54.158128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a609925-2705-4bc0-9822-d007c0ffe565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:54.159070 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609925-2705-4bc0-9822-d007c0ffe565 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.159525 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609925-2705-4bc0-9822-d007c0ffe565 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.159994 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609925-2705-4bc0-9822-d007c0ffe565 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.173810 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a609925-2705-4bc0-9822-d007c0ffe565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9a609925-2705-4bc0-9822-d007c0ffe565 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:54.180023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:54.181053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 18 11:27:54.182038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:54.183973 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 137/277] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:27:54.184861 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcecc3-124f-47a3-829f-80fa98ad34f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:54.185499 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcecc3-124f-47a3-829f-80fa98ad34f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.185777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcecc3-124f-47a3-829f-80fa98ad34f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.186047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcecc3-124f-47a3-829f-80fa98ad34f2 admin admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.195393 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcecc3-124f-47a3-829f-80fa98ad34f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:54.195393 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcecc3-124f-47a3-829f-80fa98ad34f2 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:54.196148 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 141/278] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 18 11:27:54 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:54.196810 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a609925-2705-4bc0-9822-d007c0ffe565 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:54.202125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcecc3-124f-47a3-829f-80fa98ad34f2 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:54.226910 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcecc3-124f-47a3-829f-80fa98ad34f2 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:54.260471 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8175b-6693-4fc9-a6a6-9e544427b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:54.260800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8175b-6693-4fc9-a6a6-9e544427b0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.261078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8175b-6693-4fc9-a6a6-9e544427b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.261347 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8175b-6693-4fc9-a6a6-9e544427b0c6 admin admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df/groups/80bf4fe523734c8a8fe9337d48fa3c23/roles/9e0338b743904d8ea8d77f7cea397655` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.272386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8175b-6693-4fc9-a6a6-9e544427b0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afad98494253442ca485960bb1d083df, group_id=80bf4fe523734c8a8fe9337d48fa3c23, role_id=9e0338b743904d8ea8d77f7cea397655)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:54.275202 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8175b-6693-4fc9-a6a6-9e544427b0c6 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:54.309881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 142/279] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 18 11:27:54 2022] PUT /identity/v3/projects/afad98494253442ca485960bb1d083df/groups/80bf4fe523734c8a8fe9337d48fa3c23/roles/9e0338b743904d8ea8d77f7cea397655 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:54.312776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a609925-2705-4bc0-9822-d007c0ffe565 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:54.356233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:54.357195 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.357613 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.358060 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.358951 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:54.359420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:54.360958 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:54.370906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 138/280] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:54.376291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8175b-6693-4fc9-a6a6-9e544427b0c6 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:54.499633 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8175b-6693-4fc9-a6a6-9e544427b0c6 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:54.543211 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b5122-a436-462d-9a0a-7e0b589e2bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:54.544212 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b5122-a436-462d-9a0a-7e0b589e2bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.544682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b5122-a436-462d-9a0a-7e0b589e2bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.545184 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b5122-a436-462d-9a0a-7e0b589e2bf1 None admin] PATH_INFO: `/v3/users/48f92d0788894e4c8eb8847acd68d27f` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.546560 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b5122-a436-462d-9a0a-7e0b589e2bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=48f92d0788894e4c8eb8847acd68d27f)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:54.548212 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b5122-a436-462d-9a0a-7e0b589e2bf1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:54.550025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 143/281] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:27:54 2022] GET /identity/v3/users/48f92d0788894e4c8eb8847acd68d27f => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:27:54.556703 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:54.570233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:54.678222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090dc63-1812-4179-ac30-38065dab4eff None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:54.715813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9334e-ccbe-4a71-b56a-d185ecabda9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:54.716421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9334e-ccbe-4a71-b56a-d185ecabda9f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.716696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9334e-ccbe-4a71-b56a-d185ecabda9f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.716964 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9334e-ccbe-4a71-b56a-d185ecabda9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.717685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9334e-ccbe-4a71-b56a-d185ecabda9f None admin] RBAC: Adding query filter params (role.id=07e01b6649654a428718e8c9400f41b1, user.id=48f92d0788894e4c8eb8847acd68d27f, scope.system=all) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:54.717985 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9334e-ccbe-4a71-b56a-d185ecabda9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:54.719510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9334e-ccbe-4a71-b56a-d185ecabda9f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:54.733160 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 139/282] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Oct 18 11:27:54 2022] GET /identity/v3/role_assignments?user.id=48f92d0788894e4c8eb8847acd68d27f&scope.system=all&role.id=07e01b6649654a428718e8c9400f41b1 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:54.771666 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee73b-3e33-4596-aa32-9fdd9d155e01 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.771874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee73b-3e33-4596-aa32-9fdd9d155e01 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.772153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee73b-3e33-4596-aa32-9fdd9d155e01 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.773633 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 144/283] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:54.779491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854f83-b764-48b8-bd2d-e5fdec9e641d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:54.779774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854f83-b764-48b8-bd2d-e5fdec9e641d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:54.780049 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb854f83-b764-48b8-bd2d-e5fdec9e641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:54.805323 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-cb854f83-b764-48b8-bd2d-e5fdec9e641d None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:54.806743 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-cb854f83-b764-48b8-bd2d-e5fdec9e641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:54.894700 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 140/284] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 11:27:55.321600 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cee73b-3e33-4596-aa32-9fdd9d155e01 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:55.336058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cee73b-3e33-4596-aa32-9fdd9d155e01 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:55.343830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba280a1-61ca-4b89-b590-2dc826aa30e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:55.344459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba280a1-61ca-4b89-b590-2dc826aa30e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:55.344735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba280a1-61ca-4b89-b590-2dc826aa30e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:55.345005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba280a1-61ca-4b89-b590-2dc826aa30e3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:55.358521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba280a1-61ca-4b89-b590-2dc826aa30e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2ba280a1-61ca-4b89-b590-2dc826aa30e3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:55.363477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:55.365013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:55.365791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 145/285] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 18 11:27:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:55.374117 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb854f83-b764-48b8-bd2d-e5fdec9e641d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:55.388361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb854f83-b764-48b8-bd2d-e5fdec9e641d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:55.399317 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:55.400245 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:55.400760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:55.401239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:55.402100 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:55.402596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:55.403823 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:27:55.403823 dv-cinder-815582-17-smb devstack@keystone.service[81703]: warnings.warn(msg) Oct 18 11:27:55.403823 dv-cinder-815582-17-smb devstack@keystone.service[81703]: Oct 18 11:27:55.405127 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:55.415290 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 141/286] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 18 11:27:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:55.421147 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba280a1-61ca-4b89-b590-2dc826aa30e3 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:55.437654 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba280a1-61ca-4b89-b590-2dc826aa30e3 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:55.443399 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672188b-6aa7-41c5-9785-c88d298585e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:55.444029 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672188b-6aa7-41c5-9785-c88d298585e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:55.444300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672188b-6aa7-41c5-9785-c88d298585e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:55.444565 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672188b-6aa7-41c5-9785-c88d298585e5 admin admin] PATH_INFO: `/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:55.447929 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672188b-6aa7-41c5-9785-c88d298585e5 admin admin] RBAC: Authorizing `identity:get_group(group_id=80bf4fe523734c8a8fe9337d48fa3c23)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:55.449897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672188b-6aa7-41c5-9785-c88d298585e5 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:55.451782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 146/287] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 18 11:27:55 2022] GET /identity/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:55.457289 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:55.463469 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:55.475235 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d1968-e0c1-4276-adc8-7f909300be29 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:55.482985 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76040b-9615-423f-80de-bd7989701d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:55.484054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76040b-9615-423f-80de-bd7989701d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:55.484542 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76040b-9615-423f-80de-bd7989701d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:55.485062 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76040b-9615-423f-80de-bd7989701d83 admin admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:55.486561 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76040b-9615-423f-80de-bd7989701d83 admin admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:55.489020 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76040b-9615-423f-80de-bd7989701d83 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:55.492556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 142/288] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 18 11:27:55 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:55.498912 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672188b-6aa7-41c5-9785-c88d298585e5 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:55.516122 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672188b-6aa7-41c5-9785-c88d298585e5 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:55.523724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b86449-81f5-42d1-95d8-4d49e25921e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:55.524410 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86449-81f5-42d1-95d8-4d49e25921e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:55.524687 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86449-81f5-42d1-95d8-4d49e25921e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:55.524957 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b86449-81f5-42d1-95d8-4d49e25921e1 admin admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df/groups/80bf4fe523734c8a8fe9337d48fa3c23/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:55.532519 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86449-81f5-42d1-95d8-4d49e25921e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afad98494253442ca485960bb1d083df, group_id=80bf4fe523734c8a8fe9337d48fa3c23, role_id=bfb1cb6dbfcf40ad9ba6b353b461eea6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:55.535269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b86449-81f5-42d1-95d8-4d49e25921e1 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:55.566827 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 147/289] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 18 11:27:55 2022] PUT /identity/v3/projects/afad98494253442ca485960bb1d083df/groups/80bf4fe523734c8a8fe9337d48fa3c23/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:55.653222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8028-b964-4f8b-aad9-983761ccc896 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:55.654179 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8028-b964-4f8b-aad9-983761ccc896 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:55.654650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8028-b964-4f8b-aad9-983761ccc896 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:55.656300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 143/290] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:55.662253 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fac90-ed35-4880-834a-dc3a93e599e4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:55.662533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fac90-ed35-4880-834a-dc3a93e599e4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:55.662801 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fac90-ed35-4880-834a-dc3a93e599e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:55.692997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c09fac90-ed35-4880-834a-dc3a93e599e4 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:55.694215 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c09fac90-ed35-4880-834a-dc3a93e599e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:55.708867 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:55.767218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 148/291] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 18 11:27:56.096517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8028-b964-4f8b-aad9-983761ccc896 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:56.112807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8028-b964-4f8b-aad9-983761ccc896 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:56.118042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d8595-cc77-4dc1-84a0-1dc087d349c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:56.118666 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d8595-cc77-4dc1-84a0-1dc087d349c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:56.118941 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d8595-cc77-4dc1-84a0-1dc087d349c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:56.119322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d8595-cc77-4dc1-84a0-1dc087d349c9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:56.134971 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d8595-cc77-4dc1-84a0-1dc087d349c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ef9d8595-cc77-4dc1-84a0-1dc087d349c9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:56.140300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:56.141170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:56.141963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 144/292] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 18 11:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:56.147448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fac90-ed35-4880-834a-dc3a93e599e4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:56.156669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fac90-ed35-4880-834a-dc3a93e599e4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:56.170961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:56.171590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:56.171870 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:56.172145 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:56.172812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:56.173113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:56.174728 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:56.190004 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 149/293] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 18 11:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:56.195443 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d8595-cc77-4dc1-84a0-1dc087d349c9 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:56.205811 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d8595-cc77-4dc1-84a0-1dc087d349c9 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:56.212194 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1848f-f1b6-42b2-a05d-a6d0e5974e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:56.212884 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1848f-f1b6-42b2-a05d-a6d0e5974e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:56.213214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1848f-f1b6-42b2-a05d-a6d0e5974e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:56.213487 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1848f-f1b6-42b2-a05d-a6d0e5974e82 admin admin] PATH_INFO: `/v3/groups/2fc4b5afc08240b9aa81f8180f3c07e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:56.219152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1848f-f1b6-42b2-a05d-a6d0e5974e82 admin admin] RBAC: Authorizing `identity:get_group(group_id=2fc4b5afc08240b9aa81f8180f3c07e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:56.221190 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1848f-f1b6-42b2-a05d-a6d0e5974e82 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:56.222836 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 145/294] 10.222.0.18 () {56 vars in 1201 bytes} [Tue Oct 18 11:27:56 2022] GET /identity/v3/groups/2fc4b5afc08240b9aa81f8180f3c07e5 => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:56.229240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:56.245182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415876-e219-48ca-ad43-de7ebc9eec3d admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:56.255771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af575eee-e045-426d-85a0-4eeaef5a9c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:56.256421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af575eee-e045-426d-85a0-4eeaef5a9c6e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:56.256702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af575eee-e045-426d-85a0-4eeaef5a9c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:56.256976 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af575eee-e045-426d-85a0-4eeaef5a9c6e admin admin] PATH_INFO: `/v3/projects/cdaa8f68f2eb45d98feb8999be80016c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:56.263953 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af575eee-e045-426d-85a0-4eeaef5a9c6e admin admin] RBAC: Authorizing `identity:get_project(project_id=cdaa8f68f2eb45d98feb8999be80016c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:56.265782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af575eee-e045-426d-85a0-4eeaef5a9c6e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:56.267763 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 150/295] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Oct 18 11:27:56 2022] GET /identity/v3/projects/cdaa8f68f2eb45d98feb8999be80016c => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:56.273402 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1848f-f1b6-42b2-a05d-a6d0e5974e82 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:56.283916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1848f-f1b6-42b2-a05d-a6d0e5974e82 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:56.292004 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d29b1-1139-4ef1-87fd-e109263a219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:56.292720 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d29b1-1139-4ef1-87fd-e109263a219f admin admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:56.293000 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d29b1-1139-4ef1-87fd-e109263a219f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:56.293273 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d29b1-1139-4ef1-87fd-e109263a219f admin admin] PATH_INFO: `/v3/projects/cdaa8f68f2eb45d98feb8999be80016c/groups/2fc4b5afc08240b9aa81f8180f3c07e5/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:56.295295 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d29b1-1139-4ef1-87fd-e109263a219f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdaa8f68f2eb45d98feb8999be80016c, group_id=2fc4b5afc08240b9aa81f8180f3c07e5, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:56.298141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d29b1-1139-4ef1-87fd-e109263a219f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:56.329060 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 146/296] 10.222.0.18 () {58 vars in 1463 bytes} [Tue Oct 18 11:27:56 2022] PUT /identity/v3/projects/cdaa8f68f2eb45d98feb8999be80016c/groups/2fc4b5afc08240b9aa81f8180f3c07e5/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:27:56.914498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633ee0f-e806-44a8-b05b-ebfcc09aea27 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:56.915136 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633ee0f-e806-44a8-b05b-ebfcc09aea27 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:56.915136 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633ee0f-e806-44a8-b05b-ebfcc09aea27 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:56.916768 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 151/297] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:56.922169 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d662e-8465-4764-8fa2-60a555fcbe79 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:56.922636 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d662e-8465-4764-8fa2-60a555fcbe79 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:56.922785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d662e-8465-4764-8fa2-60a555fcbe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:56.948312 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0a4d662e-8465-4764-8fa2-60a555fcbe79 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:56.949510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0a4d662e-8465-4764-8fa2-60a555fcbe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:57.045402 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 147/298] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:27:57.169788 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612ddf-59ae-4205-902f-602f9bb9722b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:57.170113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612ddf-59ae-4205-902f-602f9bb9722b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:57.170350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82612ddf-59ae-4205-902f-602f9bb9722b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:57.172007 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 152/299] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:57.177668 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2b6c-f68f-49a1-95d6-5244879d51d4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:57.177952 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2b6c-f68f-49a1-95d6-5244879d51d4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:57.178227 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd2b6c-f68f-49a1-95d6-5244879d51d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:57.204611 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-89cd2b6c-f68f-49a1-95d6-5244879d51d4 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:57.205789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-89cd2b6c-f68f-49a1-95d6-5244879d51d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:57.284306 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 148/300] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:57.408572 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82612ddf-59ae-4205-902f-602f9bb9722b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:57.463629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3314fe0-f28e-4c5a-a898-f81b559100af None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:57.463934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3314fe0-f28e-4c5a-a898-f81b559100af None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:57.464094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3314fe0-f28e-4c5a-a898-f81b559100af None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:57.465702 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 149/301] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:57.470881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4e927-a558-4486-8db3-8cc670bdc024 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:57.471437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4e927-a558-4486-8db3-8cc670bdc024 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:57.471900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4e927-a558-4486-8db3-8cc670bdc024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:57.506057 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-77f4e927-a558-4486-8db3-8cc670bdc024 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:57.507588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-77f4e927-a558-4486-8db3-8cc670bdc024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:57.551519 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:57.599707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82612ddf-59ae-4205-902f-602f9bb9722b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:57.649448 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 150/302] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:57.662301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c820b-4904-4f8c-bffc-408e59c64369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:57.663414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c820b-4904-4f8c-bffc-408e59c64369 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:57.663614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4e927-a558-4486-8db3-8cc670bdc024 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:57.664166 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c820b-4904-4f8c-bffc-408e59c64369 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:57.664628 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c820b-4904-4f8c-bffc-408e59c64369 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:57.690457 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c820b-4904-4f8c-bffc-408e59c64369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f73c820b-4904-4f8c-bffc-408e59c64369 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:57.699153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:57.700067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:57.700844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:57.705748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 153/303] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:57.712244 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c820b-4904-4f8c-bffc-408e59c64369 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:57.733401 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:57.843355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4e927-a558-4486-8db3-8cc670bdc024 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:57.914060 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dff76-40b1-41e5-b748-88d092c48902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:57.915113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dff76-40b1-41e5-b748-88d092c48902 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:57.916333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dff76-40b1-41e5-b748-88d092c48902 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:57.917322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dff76-40b1-41e5-b748-88d092c48902 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:57.919953 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c820b-4904-4f8c-bffc-408e59c64369 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:57.946247 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dff76-40b1-41e5-b748-88d092c48902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6e1dff76-40b1-41e5-b748-88d092c48902 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:57.951776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:57.952652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:57.953436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 151/304] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:27:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:57.964277 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dff76-40b1-41e5-b748-88d092c48902 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:57.966558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:57.967386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:57.967830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:57.968266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:57.969113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] RBAC: Adding query filter params (name=member) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:57.969577 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:57.971094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:57.980695 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 154/305] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:57.986500 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:58.008110 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:58.062721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:58.108635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3675b-49e0-4d7d-94ce-8399628ff764 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:58.125230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dff76-40b1-41e5-b748-88d092c48902 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:58.155489 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28856c7-c18b-41d8-9d11-18f1fde07de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:58.156888 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28856c7-c18b-41d8-9d11-18f1fde07de9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:58.157514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28856c7-c18b-41d8-9d11-18f1fde07de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:58.158072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28856c7-c18b-41d8-9d11-18f1fde07de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:58.181938 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:58.182549 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:58.182825 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:58.183094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:58.183783 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:58.184083 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:58.185465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:58.200751 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 152/306] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:27:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:58.201641 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:58.252166 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28856c7-c18b-41d8-9d11-18f1fde07de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:58.254203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28856c7-c18b-41d8-9d11-18f1fde07de9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:58.304126 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:58.334334 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d651645-5193-4ad1-98c2-6337ecf4936c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:58.335712 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:58.375448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 155/307] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 18 11:27:58.376318 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28856c7-c18b-41d8-9d11-18f1fde07de9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:58.387135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc945bd-89e7-4a06-82cb-e28ba1ef62b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:58.388565 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc945bd-89e7-4a06-82cb-e28ba1ef62b8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:58.389460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc945bd-89e7-4a06-82cb-e28ba1ef62b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:58.390122 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc945bd-89e7-4a06-82cb-e28ba1ef62b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:58.405150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc945bd-89e7-4a06-82cb-e28ba1ef62b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-dcc945bd-89e7-4a06-82cb-e28ba1ef62b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:58.413627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:58.414559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 18 11:27:58.415479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:27:58.418400 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 153/308] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:58.418400 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc945bd-89e7-4a06-82cb-e28ba1ef62b8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:58.511367 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28856c7-c18b-41d8-9d11-18f1fde07de9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:58.553630 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc650-fc0b-44ab-b503-0a0f9d692b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:58.554563 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc650-fc0b-44ab-b503-0a0f9d692b6c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:58.555041 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc650-fc0b-44ab-b503-0a0f9d692b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:58.555144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc945bd-89e7-4a06-82cb-e28ba1ef62b8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:58.555599 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc650-fc0b-44ab-b503-0a0f9d692b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:58.603136 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3acf33-836c-4146-8b00-420ab96a75a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:58.604189 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3acf33-836c-4146-8b00-420ab96a75a0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:58.604545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3acf33-836c-4146-8b00-420ab96a75a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:58.604889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3acf33-836c-4146-8b00-420ab96a75a0 None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:58.607561 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3acf33-836c-4146-8b00-420ab96a75a0 None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:58.609102 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3acf33-836c-4146-8b00-420ab96a75a0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:58.610872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 154/309] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:58 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:58.611918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:58.613138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3acf33-836c-4146-8b00-420ab96a75a0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:58.626461 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:58.652967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc650-fc0b-44ab-b503-0a0f9d692b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:58.654833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc650-fc0b-44ab-b503-0a0f9d692b6c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:58.745627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3acf33-836c-4146-8b00-420ab96a75a0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:58.781157 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 156/310] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:58.781857 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc650-fc0b-44ab-b503-0a0f9d692b6c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:58.787188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba40750-f250-423b-abe9-648b066d25a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:58.787834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40750-f250-423b-abe9-648b066d25a0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:58.788109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40750-f250-423b-abe9-648b066d25a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:58.788374 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40750-f250-423b-abe9-648b066d25a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:58.789040 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba40750-f250-423b-abe9-648b066d25a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:58.789338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba40750-f250-423b-abe9-648b066d25a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:58.790710 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba40750-f250-423b-abe9-648b066d25a0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:58.801160 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 155/311] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:27:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:58.803011 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1d2e-14c3-482c-8a1c-e36f6b9a811f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:58.803392 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1d2e-14c3-482c-8a1c-e36f6b9a811f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:58.803666 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a1d2e-14c3-482c-8a1c-e36f6b9a811f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:58.804919 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 156/312] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:58.805610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a1d2e-14c3-482c-8a1c-e36f6b9a811f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:58.882730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:58.910095 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:58.924379 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc650-fc0b-44ab-b503-0a0f9d692b6c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:58.956997 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a1d2e-14c3-482c-8a1c-e36f6b9a811f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:58.968039 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20802e1f-e4f6-426e-a335-53d7d878c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:58.968680 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802e1f-e4f6-426e-a335-53d7d878c133 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:58.969276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802e1f-e4f6-426e-a335-53d7d878c133 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:58.969556 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802e1f-e4f6-426e-a335-53d7d878c133 None admin] PATH_INFO: `/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:58.970830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20802e1f-e4f6-426e-a335-53d7d878c133 None admin] RBAC: Authorizing `identity:get_group(group_id=80bf4fe523734c8a8fe9337d48fa3c23)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:58.973419 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20802e1f-e4f6-426e-a335-53d7d878c133 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:58.974134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 157/313] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 18 11:27:58 2022] GET /identity/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:58.974885 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20802e1f-e4f6-426e-a335-53d7d878c133 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:59.013077 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca387cf-3dce-4e49-a673-0a3183e5f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:59.014711 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca387cf-3dce-4e49-a673-0a3183e5f1ea None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.014711 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca387cf-3dce-4e49-a673-0a3183e5f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.014711 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca387cf-3dce-4e49-a673-0a3183e5f1ea None admin] PATH_INFO: `/v3/projects/aaa83f531a904af69ed3a6154f029a5b` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.017499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca387cf-3dce-4e49-a673-0a3183e5f1ea None admin] RBAC: Authorizing `identity:get_project(project_id=aaa83f531a904af69ed3a6154f029a5b)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:59.017647 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca387cf-3dce-4e49-a673-0a3183e5f1ea None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:59.020898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 157/314] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:58 2022] GET /identity/v3/projects/aaa83f531a904af69ed3a6154f029a5b => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:59.022204 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e19f3-ef12-4cc6-bf97-c850679bc034 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.022486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e19f3-ef12-4cc6-bf97-c850679bc034 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.022754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e19f3-ef12-4cc6-bf97-c850679bc034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.045636 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-191e19f3-ef12-4cc6-bf97-c850679bc034 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:59.046775 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-191e19f3-ef12-4cc6-bf97-c850679bc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:59.113519 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20802e1f-e4f6-426e-a335-53d7d878c133 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:59.133520 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 158/315] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:59.134306 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e19f3-ef12-4cc6-bf97-c850679bc034 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:59.163988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e50cd-cea5-42b5-a064-842503cbd84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:59.164598 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e50cd-cea5-42b5-a064-842503cbd84b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.164967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e50cd-cea5-42b5-a064-842503cbd84b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.165160 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e50cd-cea5-42b5-a064-842503cbd84b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.176206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:59.219052 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:59.265292 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e50cd-cea5-42b5-a064-842503cbd84b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:59.267488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e50cd-cea5-42b5-a064-842503cbd84b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:59.277806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e19f3-ef12-4cc6-bf97-c850679bc034 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:59.320796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:59.321637 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.321914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.322187 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.323414 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] RBAC: Adding query filter params (group.id=80bf4fe523734c8a8fe9337d48fa3c23, role.id=9e0338b743904d8ea8d77f7cea397655, scope.project.id=aaa83f531a904af69ed3a6154f029a5b) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:59.323414 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:59.325659 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:59.333128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 159/316] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 18 11:27:59 2022] GET /identity/v3/role_assignments?group.id=80bf4fe523734c8a8fe9337d48fa3c23&scope.project.id=aaa83f531a904af69ed3a6154f029a5b&role.id=9e0338b743904d8ea8d77f7cea397655 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:59.337030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:59.411934 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 158/317] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:27:59.418459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df2e3-6734-40d5-88c3-bf5869d1ff1f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.418459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df2e3-6734-40d5-88c3-bf5869d1ff1f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.418459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df2e3-6734-40d5-88c3-bf5869d1ff1f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.418459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 159/318] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:27:59.419442 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3df2e3-6734-40d5-88c3-bf5869d1ff1f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:59.473426 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:59.487115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acde5f-2c86-4c35-ab06-37401caf5d65 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:59.525174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:59.532804 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0961f42-19dd-4539-a55c-7b8024eb6e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:59.533462 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961f42-19dd-4539-a55c-7b8024eb6e26 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.533722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961f42-19dd-4539-a55c-7b8024eb6e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.533993 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961f42-19dd-4539-a55c-7b8024eb6e26 None admin] PATH_INFO: `/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.535121 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0961f42-19dd-4539-a55c-7b8024eb6e26 None admin] RBAC: Authorizing `identity:get_group(group_id=80bf4fe523734c8a8fe9337d48fa3c23)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:59.537302 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0961f42-19dd-4539-a55c-7b8024eb6e26 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:59.539625 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 160/319] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 18 11:27:59 2022] GET /identity/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:59.540486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0961f42-19dd-4539-a55c-7b8024eb6e26 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:59.548833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3df2e3-6734-40d5-88c3-bf5869d1ff1f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:59.594382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c8d4e-3dca-4a65-9bf7-f8a947efbb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:59.595099 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c8d4e-3dca-4a65-9bf7-f8a947efbb5f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.595509 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c8d4e-3dca-4a65-9bf7-f8a947efbb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.595875 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c8d4e-3dca-4a65-9bf7-f8a947efbb5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.608313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c8d4e-3dca-4a65-9bf7-f8a947efbb5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e53c8d4e-3dca-4a65-9bf7-f8a947efbb5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:27:59.613180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:27:59.614608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:27:59.615491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 160/320] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:27:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:27:59.620462 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1bf80-0c6e-45d9-987f-5d974b0ff783 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.620738 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1bf80-0c6e-45d9-987f-5d974b0ff783 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.621042 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1bf80-0c6e-45d9-987f-5d974b0ff783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.641537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f3e1bf80-0c6e-45d9-987f-5d974b0ff783 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:27:59.642721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f3e1bf80-0c6e-45d9-987f-5d974b0ff783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:27:59.658917 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0961f42-19dd-4539-a55c-7b8024eb6e26 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:59.703342 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299087-1e56-4fda-b3f4-0f3513c8dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:59.703631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299087-1e56-4fda-b3f4-0f3513c8dc03 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.703909 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299087-1e56-4fda-b3f4-0f3513c8dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.704183 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10299087-1e56-4fda-b3f4-0f3513c8dc03 None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.706551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10299087-1e56-4fda-b3f4-0f3513c8dc03 None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:59.708721 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10299087-1e56-4fda-b3f4-0f3513c8dc03 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:59.710874 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 161/321] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:27:59 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:59.711651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299087-1e56-4fda-b3f4-0f3513c8dc03 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:59.724528 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 161/322] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:27:59.725390 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1bf80-0c6e-45d9-987f-5d974b0ff783 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:59.766310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:59.791744 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:27:59.839960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10299087-1e56-4fda-b3f4-0f3513c8dc03 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:59.857649 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1bf80-0c6e-45d9-987f-5d974b0ff783 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:27:59.885654 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:59.886263 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.886531 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.886804 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.887565 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] RBAC: Adding query filter params (group.id=80bf4fe523734c8a8fe9337d48fa3c23, role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6, scope.project.id=aaa83f531a904af69ed3a6154f029a5b) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:59.887871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:59.891347 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:59.898387 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:27:59.898560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 162/323] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 18 11:27:59 2022] GET /identity/v3/role_assignments?group.id=80bf4fe523734c8a8fe9337d48fa3c23&scope.project.id=aaa83f531a904af69ed3a6154f029a5b&role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:59.898806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:27:59.898999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:27:59.899109 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:27:59.899371 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:27:59.900041 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:27:59.900342 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:27:59.901713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:27:59.911833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 162/324] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:27:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:27:59.918113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.028743 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:00.043075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa33d-2244-4707-be58-b00501e252fa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.043638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec24f8-b04f-4d57-88ac-2a500ec89bdd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.079191 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:00.085421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b40b-0784-4c91-9ac7-552bfae24bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.086320 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b40b-0784-4c91-9ac7-552bfae24bdb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.086608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b40b-0784-4c91-9ac7-552bfae24bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.086878 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b40b-0784-4c91-9ac7-552bfae24bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.087773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c97f-2f7d-46d1-8849-3e6b1c0dfb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.089271 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c97f-2f7d-46d1-8849-3e6b1c0dfb5e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.089271 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c97f-2f7d-46d1-8849-3e6b1c0dfb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.089271 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3c97f-2f7d-46d1-8849-3e6b1c0dfb5e None admin] PATH_INFO: `/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.092915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c97f-2f7d-46d1-8849-3e6b1c0dfb5e None admin] RBAC: Authorizing `identity:get_group(group_id=80bf4fe523734c8a8fe9337d48fa3c23)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.095425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3c97f-2f7d-46d1-8849-3e6b1c0dfb5e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.097321 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 163/325] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 18 11:27:59 2022] GET /identity/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:00.097984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c97f-2f7d-46d1-8849-3e6b1c0dfb5e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.181616 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03b40b-0784-4c91-9ac7-552bfae24bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.183031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03b40b-0784-4c91-9ac7-552bfae24bdb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.239007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3c97f-2f7d-46d1-8849-3e6b1c0dfb5e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.277825 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552790-1820-4dd9-a266-86f82be4a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.278690 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552790-1820-4dd9-a266-86f82be4a4fc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.279146 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552790-1820-4dd9-a266-86f82be4a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.279464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552790-1820-4dd9-a266-86f82be4a4fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.290752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:00.293267 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a552790-1820-4dd9-a266-86f82be4a4fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4a552790-1820-4dd9-a266-86f82be4a4fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:00.298563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:00.299713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 164/326] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:00.300560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552790-1820-4dd9-a266-86f82be4a4fc None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.306829 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 163/327] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 18 11:28:00.312221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b40b-0784-4c91-9ac7-552bfae24bdb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.365214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:00.407229 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552790-1820-4dd9-a266-86f82be4a4fc None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.413923 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b40b-0784-4c91-9ac7-552bfae24bdb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.440319 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.440815 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.441089 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.441358 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.442115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] RBAC: Adding query filter params (group.id=80bf4fe523734c8a8fe9337d48fa3c23, role.id=9e0338b743904d8ea8d77f7cea397655, scope.project.id=afad98494253442ca485960bb1d083df) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:00.442417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.443877 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.447350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781b903-6368-490e-9beb-077be35da98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.447949 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781b903-6368-490e-9beb-077be35da98f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.448256 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781b903-6368-490e-9beb-077be35da98f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.448529 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781b903-6368-490e-9beb-077be35da98f None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.449188 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781b903-6368-490e-9beb-077be35da98f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:00.449486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781b903-6368-490e-9beb-077be35da98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.449582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 165/328] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/role_assignments?group.id=80bf4fe523734c8a8fe9337d48fa3c23&scope.project.id=afad98494253442ca485960bb1d083df&role.id=9e0338b743904d8ea8d77f7cea397655 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:00.450260 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.450887 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781b903-6368-490e-9beb-077be35da98f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.460525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 164/329] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:00.466643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781b903-6368-490e-9beb-077be35da98f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.529858 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:00.562795 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74a05f-c351-413a-92eb-cdfded59a9f1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.586220 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781b903-6368-490e-9beb-077be35da98f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.589778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:00.603887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee8c46-2161-44e6-b75f-2ba7076af6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.604527 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee8c46-2161-44e6-b75f-2ba7076af6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.604801 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee8c46-2161-44e6-b75f-2ba7076af6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.605071 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee8c46-2161-44e6-b75f-2ba7076af6a1 None admin] PATH_INFO: `/v3/projects/afad98494253442ca485960bb1d083df` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.606269 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee8c46-2161-44e6-b75f-2ba7076af6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=afad98494253442ca485960bb1d083df)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.607766 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee8c46-2161-44e6-b75f-2ba7076af6a1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.609654 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 166/330] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/projects/afad98494253442ca485960bb1d083df => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:00.616164 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee8c46-2161-44e6-b75f-2ba7076af6a1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.627227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f1d1e-b41b-43ed-a0c8-18b9e12b548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.628075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f1d1e-b41b-43ed-a0c8-18b9e12b548d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.628184 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f1d1e-b41b-43ed-a0c8-18b9e12b548d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.628393 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f1d1e-b41b-43ed-a0c8-18b9e12b548d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.703061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f1d1e-b41b-43ed-a0c8-18b9e12b548d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.704504 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f1d1e-b41b-43ed-a0c8-18b9e12b548d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.732448 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee8c46-2161-44e6-b75f-2ba7076af6a1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.766046 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:00.780044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec27ae3-43bd-4962-badd-4b25d823db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.780044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec27ae3-43bd-4962-badd-4b25d823db15 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.780044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec27ae3-43bd-4962-badd-4b25d823db15 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.780383 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec27ae3-43bd-4962-badd-4b25d823db15 None admin] PATH_INFO: `/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.782247 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec27ae3-43bd-4962-badd-4b25d823db15 None admin] RBAC: Authorizing `identity:get_group(group_id=80bf4fe523734c8a8fe9337d48fa3c23)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.782901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec27ae3-43bd-4962-badd-4b25d823db15 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.784408 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 167/331] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/groups/80bf4fe523734c8a8fe9337d48fa3c23 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:00.790517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec27ae3-43bd-4962-badd-4b25d823db15 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.822481 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 165/332] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 18 11:28:00.828166 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f1d1e-b41b-43ed-a0c8-18b9e12b548d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:00.867739 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:00.910142 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec27ae3-43bd-4962-badd-4b25d823db15 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.933070 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f1d1e-b41b-43ed-a0c8-18b9e12b548d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:00.943925 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.944510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.944785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.945048 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.945752 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] RBAC: Adding query filter params (group.id=80bf4fe523734c8a8fe9337d48fa3c23, role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6, scope.project.id=afad98494253442ca485960bb1d083df) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:00.946055 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.947551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.953504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 168/333] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/role_assignments?group.id=80bf4fe523734c8a8fe9337d48fa3c23&scope.project.id=afad98494253442ca485960bb1d083df&role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:00.972728 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163d439-3bf3-4bc0-b4a0-8c1594153262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:00.973507 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163d439-3bf3-4bc0-b4a0-8c1594153262 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:00.973905 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163d439-3bf3-4bc0-b4a0-8c1594153262 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:00.974177 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163d439-3bf3-4bc0-b4a0-8c1594153262 None admin] PATH_INFO: `/v3/projects/cdaa8f68f2eb45d98feb8999be80016c` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:00.975467 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163d439-3bf3-4bc0-b4a0-8c1594153262 None admin] RBAC: Authorizing `identity:get_project(project_id=cdaa8f68f2eb45d98feb8999be80016c)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:00.976959 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163d439-3bf3-4bc0-b4a0-8c1594153262 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:00.978664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 166/334] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/projects/cdaa8f68f2eb45d98feb8999be80016c => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:00.984550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:01.087367 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905a900-0006-4754-85d1-6b77dce4349c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:01.110148 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:01.122543 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a657-18af-4e8f-8783-7e04d2fb3198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:01.123182 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a657-18af-4e8f-8783-7e04d2fb3198 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:01.123485 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a657-18af-4e8f-8783-7e04d2fb3198 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:01.123752 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a657-18af-4e8f-8783-7e04d2fb3198 None admin] PATH_INFO: `/v3/groups/2fc4b5afc08240b9aa81f8180f3c07e5` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:01.124858 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a657-18af-4e8f-8783-7e04d2fb3198 None admin] RBAC: Authorizing `identity:get_group(group_id=2fc4b5afc08240b9aa81f8180f3c07e5)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:01.126275 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a657-18af-4e8f-8783-7e04d2fb3198 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:01.127863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 169/335] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Oct 18 11:28:00 2022] GET /identity/v3/groups/2fc4b5afc08240b9aa81f8180f3c07e5 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:01.134820 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163d439-3bf3-4bc0-b4a0-8c1594153262 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:01.158274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:01.249498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163d439-3bf3-4bc0-b4a0-8c1594153262 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:01.290353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a85fa8-1a7d-4757-9450-9cabee046cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:01.290952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85fa8-1a7d-4757-9450-9cabee046cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:01.291226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85fa8-1a7d-4757-9450-9cabee046cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:01.291521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a85fa8-1a7d-4757-9450-9cabee046cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:01.292515 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85fa8-1a7d-4757-9450-9cabee046cb1 None admin] RBAC: Adding query filter params (group.id=2fc4b5afc08240b9aa81f8180f3c07e5, role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=cdaa8f68f2eb45d98feb8999be80016c) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:01.292821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85fa8-1a7d-4757-9450-9cabee046cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:01.294233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a85fa8-1a7d-4757-9450-9cabee046cb1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:01.300273 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 167/336] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Oct 18 11:28:01 2022] GET /identity/v3/role_assignments?group.id=2fc4b5afc08240b9aa81f8180f3c07e5&scope.project.id=cdaa8f68f2eb45d98feb8999be80016c&role.id=78ddf427bf274205867c7492aec1f590 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:04.029602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada94dc-da08-4f78-8c56-b73f7ff688f7 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:04.030622 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada94dc-da08-4f78-8c56-b73f7ff688f7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:04.031117 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada94dc-da08-4f78-8c56-b73f7ff688f7 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:04.032675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 170/337] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:04.038458 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604db8-54fd-4e8b-9721-9528bac5f6d6 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:04.039405 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604db8-54fd-4e8b-9721-9528bac5f6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:04.039884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c604db8-54fd-4e8b-9721-9528bac5f6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:04.066813 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-9c604db8-54fd-4e8b-9721-9528bac5f6d6 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:04.068924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9c604db8-54fd-4e8b-9721-9528bac5f6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:04.159646 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 168/338] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:04.238784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3f67d-2084-404a-aed2-cc87a9af822e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:04.239906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3f67d-2084-404a-aed2-cc87a9af822e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:04.240198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3f67d-2084-404a-aed2-cc87a9af822e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:04.241580 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 171/339] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:04.247082 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda52a3-da92-468a-93e2-d286b80fe82c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:04.247401 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda52a3-da92-468a-93e2-d286b80fe82c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:04.247673 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda52a3-da92-468a-93e2-d286b80fe82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:04.272208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bbda52a3-da92-468a-93e2-d286b80fe82c None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:04.273378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bbda52a3-da92-468a-93e2-d286b80fe82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:04.282827 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:04.363781 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 169/340] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:04.377476 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c63-1fbc-4e20-a959-c9e94cd02a5a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:04.377760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c63-1fbc-4e20-a959-c9e94cd02a5a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:04.378030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8c63-1fbc-4e20-a959-c9e94cd02a5a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:04.383338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 172/341] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:04.392670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29fbc0-00d6-4e87-ac81-364212f4d37b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:04.392954 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29fbc0-00d6-4e87-ac81-364212f4d37b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:04.393225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29fbc0-00d6-4e87-ac81-364212f4d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:04.417073 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-7f29fbc0-00d6-4e87-ac81-364212f4d37b None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:04.418158 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7f29fbc0-00d6-4e87-ac81-364212f4d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:04.501731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 170/342] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:04.590746 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8c63-1fbc-4e20-a959-c9e94cd02a5a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:04.693256 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29fbc0-00d6-4e87-ac81-364212f4d37b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:04.717107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8c63-1fbc-4e20-a959-c9e94cd02a5a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:04.757242 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:04.757884 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:04.758161 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:04.758431 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:04.780083 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:04.782003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:04.807582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:04.808572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:04.809404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:04.809404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:04.809404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:04.811581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 173/343] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:04.818161 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:04.846787 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:04.889682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29fbc0-00d6-4e87-ac81-364212f4d37b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:04.896042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:04.937702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:04.938350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:04.938630 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:04.938904 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:04.953331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:04.954979 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:04.966694 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd8572-7509-44a3-97b8-5c06a93a2c90 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:04.975479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:04.976386 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:04.977239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:04.977239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:04.977239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:04.977239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 171/344] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:04.977450 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:05.009695 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d22c6-a845-4d8e-9eaa-1cf451c2c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:05.010945 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d22c6-a845-4d8e-9eaa-1cf451c2c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.011849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d22c6-a845-4d8e-9eaa-1cf451c2c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.012456 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d22c6-a845-4d8e-9eaa-1cf451c2c2b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.013362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d22c6-a845-4d8e-9eaa-1cf451c2c2b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:05.013833 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d22c6-a845-4d8e-9eaa-1cf451c2c2b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:05.015606 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d22c6-a845-4d8e-9eaa-1cf451c2c2b6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:05.033390 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 174/345] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:05.034571 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a0c3d-ff29-4379-84fb-252ee4269d0a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.034849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a0c3d-ff29-4379-84fb-252ee4269d0a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.035117 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a0c3d-ff29-4379-84fb-252ee4269d0a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.036771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 175/346] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:05.037308 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a0c3d-ff29-4379-84fb-252ee4269d0a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:05.085400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884051f-9fe8-4147-b928-2f765ed827d6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:05.112793 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:05.122128 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:05.122756 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.123032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.123325 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.134561 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:05.136040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:05.150668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:05.151627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:05.152460 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:05.152460 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:05.152460 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:05.152460 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 172/347] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:05.152671 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:05.159726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a0c3d-ff29-4379-84fb-252ee4269d0a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:05.161553 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:05.196072 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af748-09c3-4086-aaeb-61371877b52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:05.196680 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af748-09c3-4086-aaeb-61371877b52e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.197069 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af748-09c3-4086-aaeb-61371877b52e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.197345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af748-09c3-4086-aaeb-61371877b52e None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.197978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af748-09c3-4086-aaeb-61371877b52e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:05.198284 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af748-09c3-4086-aaeb-61371877b52e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:05.199679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af748-09c3-4086-aaeb-61371877b52e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:05.211814 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 176/348] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:05.212887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbcf8c-b266-4602-84ff-5b008fe1f47a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.213170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbcf8c-b266-4602-84ff-5b008fe1f47a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.213473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbcf8c-b266-4602-84ff-5b008fe1f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.231712 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7bbbcf8c-b266-4602-84ff-5b008fe1f47a None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:05.233487 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7bbbcf8c-b266-4602-84ff-5b008fe1f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:05.266026 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e64cca-b6c2-4f10-bfd2-3d9b463b54d6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:05.300169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9e63c-b264-4090-a0f8-93736c0c9e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:05.300770 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9e63c-b264-4090-a0f8-93736c0c9e92 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.301043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9e63c-b264-4090-a0f8-93736c0c9e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.301421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9e63c-b264-4090-a0f8-93736c0c9e92 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.302578 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9e63c-b264-4090-a0f8-93736c0c9e92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:05.304207 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9e63c-b264-4090-a0f8-93736c0c9e92 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:05.315288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 177/349] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:05.315288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbcf8c-b266-4602-84ff-5b008fe1f47a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:05.335844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 173/350] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:28:05 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:05.336856 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9e63c-b264-4090-a0f8-93736c0c9e92 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:05.412146 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:05.486397 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:05.498178 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbcf8c-b266-4602-84ff-5b008fe1f47a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:05.535065 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9e63c-b264-4090-a0f8-93736c0c9e92 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:05.541334 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03d8f6-758e-40d8-88ea-87f9932ef9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:05.541947 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d8f6-758e-40d8-88ea-87f9932ef9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.542223 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d8f6-758e-40d8-88ea-87f9932ef9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.542496 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03d8f6-758e-40d8-88ea-87f9932ef9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.543144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03d8f6-758e-40d8-88ea-87f9932ef9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:05.543476 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03d8f6-758e-40d8-88ea-87f9932ef9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:05.544962 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03d8f6-758e-40d8-88ea-87f9932ef9a1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:05.558859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 178/351] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:05.560127 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3514ba-31a8-435c-95ad-ee4876c7cf9f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.560413 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3514ba-31a8-435c-95ad-ee4876c7cf9f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.563578 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3514ba-31a8-435c-95ad-ee4876c7cf9f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.565082 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 179/352] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:05.565849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3514ba-31a8-435c-95ad-ee4876c7cf9f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:05.580117 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8834b2-ea2f-43fe-beff-20dcd6f10669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:05.580736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8834b2-ea2f-43fe-beff-20dcd6f10669 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.581169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8834b2-ea2f-43fe-beff-20dcd6f10669 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.581443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8834b2-ea2f-43fe-beff-20dcd6f10669 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.582093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8834b2-ea2f-43fe-beff-20dcd6f10669 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:05.583691 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8834b2-ea2f-43fe-beff-20dcd6f10669 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:05.611060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 174/353] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:28:05 2022] POST /identity/v3/users => generated 246 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:05.612704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428884e-a3f2-4f85-bda0-0e458356d371 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.612960 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428884e-a3f2-4f85-bda0-0e458356d371 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.613233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428884e-a3f2-4f85-bda0-0e458356d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.644744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3428884e-a3f2-4f85-bda0-0e458356d371 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:05.644744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3428884e-a3f2-4f85-bda0-0e458356d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:05.712068 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3514ba-31a8-435c-95ad-ee4876c7cf9f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:05.738192 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 175/354] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:05.740803 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428884e-a3f2-4f85-bda0-0e458356d371 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:05.767727 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:05.774845 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50f516-d241-4314-a764-042376aba48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:05.775616 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50f516-d241-4314-a764-042376aba48b None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.776055 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50f516-d241-4314-a764-042376aba48b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.776401 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50f516-d241-4314-a764-042376aba48b None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.777249 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50f516-d241-4314-a764-042376aba48b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:05.778678 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50f516-d241-4314-a764-042376aba48b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:05.834436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 180/355] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:28:05 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:05.900400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428884e-a3f2-4f85-bda0-0e458356d371 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:05.948134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:05.948867 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:05.949150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:05.949418 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:05.961371 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:05.962931 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:05.981784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:05.982766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:05.983651 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:05.983651 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:05.983651 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:05.983651 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 176/356] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:05.992900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50f516-d241-4314-a764-042376aba48b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:06.009907 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:06.062739 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:06.113265 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50f516-d241-4314-a764-042376aba48b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:06.151626 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:06.152435 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:06.152998 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:06.153275 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:06.153600 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:06.154301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:06.154595 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:06.156117 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:06.170301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 181/357] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:06.175488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:06.191595 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936b3fc-13e1-4db8-a327-e495b30a02bf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:06.248028 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:06.272057 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:06.273028 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:06.273520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:06.274001 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:06.274940 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:06.276636 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:06.285373 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4a713-cac1-4e82-991a-b23ea9aa1b13 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:06.298022 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.sql.core [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 11:28:06.298022 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 18 11:28:06.298022 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [parameters: {'id': 'e39c4d614fc84f76ad5546117a0e5e6c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 18 11:28:06.298022 dv-cinder-815582-17-smb devstack@keystone.service[81702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Oct 18 11:28:06.331293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return ref.to_dict() Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:28:06.332241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application yield resource Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise self.value Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application session.commit() Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 11:28:06.333791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.flush() Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application compat.raise_( Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 11:28:06.334647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:28:06.337113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:28:06.340137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [parameters: {'id': 'e39c4d614fc84f76ad5546117a0e5e6c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:06.341663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 18 11:28:06.347716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:06.350663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8bfc4-ec8d-4600-b796-0842d4330a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:06.350663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bfc4-ec8d-4600-b796-0842d4330a0e None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:06.350663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bfc4-ec8d-4600-b796-0842d4330a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:06.350663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bfc4-ec8d-4600-b796-0842d4330a0e None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:06.351232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8bfc4-ec8d-4600-b796-0842d4330a0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:06.351232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8bfc4-ec8d-4600-b796-0842d4330a0e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:06.351749 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 177/358] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 18 11:28:06 2022] POST /identity/v3/roles => generated 144 bytes in 276 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:06.353104 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:06.375963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 182/359] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:28:06 2022] POST /identity/v3/users => generated 249 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:28:06.490119 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0235a5-0ac9-4371-b9df-352d616e945b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:06.534918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11775c80-358b-4171-98ce-c26d78864e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:06.535530 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775c80-358b-4171-98ce-c26d78864e63 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:06.537128 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775c80-358b-4171-98ce-c26d78864e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:06.537128 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775c80-358b-4171-98ce-c26d78864e63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:06.540341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:06.549952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11775c80-358b-4171-98ce-c26d78864e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-11775c80-358b-4171-98ce-c26d78864e63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:06.556737 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:06.557697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 18 11:28:06.558478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:06.562900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 178/360] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:06.564362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8bfc4-ec8d-4600-b796-0842d4330a0e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:06.697272 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8bfc4-ec8d-4600-b796-0842d4330a0e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:06.722051 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:06.734066 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba795cf5-8791-47a9-b218-f757a63090fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:06.734675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795cf5-8791-47a9-b218-f757a63090fe None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:06.734945 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795cf5-8791-47a9-b218-f757a63090fe None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:06.735307 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795cf5-8791-47a9-b218-f757a63090fe None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:06.736153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795cf5-8791-47a9-b218-f757a63090fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:06.736449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795cf5-8791-47a9-b218-f757a63090fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:06.737872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795cf5-8791-47a9-b218-f757a63090fe None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:06.748916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 183/361] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:07.874324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ca79-a469-4e6d-9f55-7ffe2d092b2a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:07.874845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ca79-a469-4e6d-9f55-7ffe2d092b2a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:07.874845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ca79-a469-4e6d-9f55-7ffe2d092b2a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:07.876517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 179/362] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:07.882326 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977db39-083d-48e4-b7cc-df7bb84f0b72 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:07.882763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977db39-083d-48e4-b7cc-df7bb84f0b72 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:07.882942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977db39-083d-48e4-b7cc-df7bb84f0b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:07.906479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2977db39-083d-48e4-b7cc-df7bb84f0b72 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:07.907674 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2977db39-083d-48e4-b7cc-df7bb84f0b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:07.993141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 184/363] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:08.453739 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274ca79-a469-4e6d-9f55-7ffe2d092b2a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:08.530159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0a2b1-6fd9-44cc-9290-05c36fb460d9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:08.530505 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0a2b1-6fd9-44cc-9290-05c36fb460d9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:08.530702 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0a2b1-6fd9-44cc-9290-05c36fb460d9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:08.537432 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 185/364] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:08.555409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94cf58-4260-4a35-84b4-eae69f03f029 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:08.556020 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94cf58-4260-4a35-84b4-eae69f03f029 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:08.556510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94cf58-4260-4a35-84b4-eae69f03f029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:08.590289 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-bc94cf58-4260-4a35-84b4-eae69f03f029 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:08.591876 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bc94cf58-4260-4a35-84b4-eae69f03f029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:08.612952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274ca79-a469-4e6d-9f55-7ffe2d092b2a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:08.655418 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95adec7-b3ac-4264-b02d-10d8df55899f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:08.656481 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95adec7-b3ac-4264-b02d-10d8df55899f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:08.657009 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95adec7-b3ac-4264-b02d-10d8df55899f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:08.657481 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95adec7-b3ac-4264-b02d-10d8df55899f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:08.672455 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95adec7-b3ac-4264-b02d-10d8df55899f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e95adec7-b3ac-4264-b02d-10d8df55899f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:08.678058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:08.678950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:08.679777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 180/365] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:08.685851 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dede80-6ad4-4161-b2bf-0500e4e472c0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:08.686113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dede80-6ad4-4161-b2bf-0500e4e472c0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:08.686328 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dede80-6ad4-4161-b2bf-0500e4e472c0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:08.687660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 181/366] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:08.688408 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dede80-6ad4-4161-b2bf-0500e4e472c0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:08.700862 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 186/367] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:28:08.703117 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb2485-4745-4c3c-826e-e44f92cc0227 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:08.703625 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb2485-4745-4c3c-826e-e44f92cc0227 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:08.704441 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb2485-4745-4c3c-826e-e44f92cc0227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:08.730220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6ceb2485-4745-4c3c-826e-e44f92cc0227 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:08.731746 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6ceb2485-4745-4c3c-826e-e44f92cc0227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:08.750669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:08.786509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:08.813109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 187/368] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:08.827547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dede80-6ad4-4161-b2bf-0500e4e472c0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:08.886682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:08.888133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:08.888635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:08.889106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:08.889968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:08.890466 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:08.892079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:08.901156 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 182/369] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:08.910256 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb2485-4745-4c3c-826e-e44f92cc0227 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.023794 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.056684 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb2485-4745-4c3c-826e-e44f92cc0227 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.120811 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.121467 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.121746 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.122018 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.140446 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:09.141917 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:09.172646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:09.173607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:09.174475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:09.174475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:09.174475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:09.174475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 188/370] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:09.180969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.203630 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2fe24-be75-429c-8005-fe3a5fe53313 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.212340 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:09.230175 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:09.253116 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207138-d155-45c0-b6df-d14e3743dc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.253976 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207138-d155-45c0-b6df-d14e3743dc88 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.254934 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207138-d155-45c0-b6df-d14e3743dc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.255395 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207138-d155-45c0-b6df-d14e3743dc88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.267084 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91207138-d155-45c0-b6df-d14e3743dc88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-91207138-d155-45c0-b6df-d14e3743dc88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:09.273265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:09.274245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:09.275078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 183/371] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:09.275783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207138-d155-45c0-b6df-d14e3743dc88 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.293726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af7082-9813-472c-a6b4-6d77ba8a0c88 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.329958 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1c36-a978-4b30-8c44-9bbd02266f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.330934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1c36-a978-4b30-8c44-9bbd02266f56 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.331504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1c36-a978-4b30-8c44-9bbd02266f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.332043 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1c36-a978-4b30-8c44-9bbd02266f56 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.333571 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee1c36-a978-4b30-8c44-9bbd02266f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:09.334061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee1c36-a978-4b30-8c44-9bbd02266f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:09.335618 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee1c36-a978-4b30-8c44-9bbd02266f56 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:09.349256 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 189/372] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:09.351761 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef81ed-f14f-4c50-a438-0720452454b2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.352182 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef81ed-f14f-4c50-a438-0720452454b2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.352584 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef81ed-f14f-4c50-a438-0720452454b2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.354324 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 190/373] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:09.355367 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef81ed-f14f-4c50-a438-0720452454b2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.383412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207138-d155-45c0-b6df-d14e3743dc88 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.418614 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8659-eede-4095-a1c9-705f6788d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.419266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8659-eede-4095-a1c9-705f6788d0bc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.419551 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8659-eede-4095-a1c9-705f6788d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.419826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8659-eede-4095-a1c9-705f6788d0bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.430380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f8659-eede-4095-a1c9-705f6788d0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7b6f8659-eede-4095-a1c9-705f6788d0bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:09.435716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:09.436810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 184/374] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:09.437639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8659-eede-4095-a1c9-705f6788d0bc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.464467 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:09.479891 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef81ed-f14f-4c50-a438-0720452454b2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.481582 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:09.516871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fd1a4-e716-4a91-86e5-024ade9bfe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.517481 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd1a4-e716-4a91-86e5-024ade9bfe73 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.517811 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd1a4-e716-4a91-86e5-024ade9bfe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.518087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fd1a4-e716-4a91-86e5-024ade9bfe73 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.518769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd1a4-e716-4a91-86e5-024ade9bfe73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:09.519072 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd1a4-e716-4a91-86e5-024ade9bfe73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:09.521023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138fd1a4-e716-4a91-86e5-024ade9bfe73 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:09.530160 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 191/375] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:09.532827 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5fd4-710b-4ebc-8317-1266faf9638e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.533421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5fd4-710b-4ebc-8317-1266faf9638e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.533772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5fd4-710b-4ebc-8317-1266faf9638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.550521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8659-eede-4095-a1c9-705f6788d0bc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.553543 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a16c5fd4-710b-4ebc-8317-1266faf9638e None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:09.554723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a16c5fd4-710b-4ebc-8317-1266faf9638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:09.588822 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.589726 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.590005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.590276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.598401 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:09.599948 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:09.614106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:09.615110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:09.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 185/376] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:09.620309 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.633968 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 192/377] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:09.634753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5fd4-710b-4ebc-8317-1266faf9638e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.736105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:09.756929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5fd4-710b-4ebc-8317-1266faf9638e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.767704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:09.773584 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c046a6-f703-459f-bbda-aff583b02b46 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.791833 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.792387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.792667 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.792935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.803599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:09.805211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:09.810194 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6360d-d021-4578-b105-c0fbee017706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.810789 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6360d-d021-4578-b105-c0fbee017706 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.811061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6360d-d021-4578-b105-c0fbee017706 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.811353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6360d-d021-4578-b105-c0fbee017706 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.812008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6360d-d021-4578-b105-c0fbee017706 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:09.812310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6360d-d021-4578-b105-c0fbee017706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:09.813662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6360d-d021-4578-b105-c0fbee017706 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:09.820910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:09.821991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:09.822946 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:09.822946 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:09.822946 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:09.822946 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 193/378] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:09.825771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.828307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 186/379] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:09.833214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543793-13e7-4939-8da9-6239c357fa1b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.833502 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543793-13e7-4939-8da9-6239c357fa1b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.833778 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a543793-13e7-4939-8da9-6239c357fa1b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.839115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 187/380] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:09.841810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543793-13e7-4939-8da9-6239c357fa1b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:09.938610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c541b-12e3-4c56-a77d-1ec62b97c288 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.954117 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a543793-13e7-4939-8da9-6239c357fa1b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:09.967496 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:09.972846 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e763-d6c5-4de0-aabb-a8d738062de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.974006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e763-d6c5-4de0-aabb-a8d738062de4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.974286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e763-d6c5-4de0-aabb-a8d738062de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.974559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e763-d6c5-4de0-aabb-a8d738062de4 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.975293 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e763-d6c5-4de0-aabb-a8d738062de4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:09.975599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e763-d6c5-4de0-aabb-a8d738062de4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:09.977019 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e763-d6c5-4de0-aabb-a8d738062de4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:09.987775 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:09.988376 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:09.988702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:09.989169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:09.989847 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:09.990146 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:09.991541 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.002501 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 188/381] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:10.003308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.012686 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 194/382] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 18 11:28:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:10.013777 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4034b6-2a49-4f85-831b-d68b67c3232e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.014064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4034b6-2a49-4f85-831b-d68b67c3232e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.014338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4034b6-2a49-4f85-831b-d68b67c3232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.030222 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.032707 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5b4034b6-2a49-4f85-831b-d68b67c3232e None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:10.033901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5b4034b6-2a49-4f85-831b-d68b67c3232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:10.100837 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 195/383] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:10.101588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4034b6-2a49-4f85-831b-d68b67c3232e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.109294 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900645a7-b928-4dfd-8e75-09563314e4ab None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.143092 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.143747 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.144039 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.144290 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.155856 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.157311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:10.174963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:10.176058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:10.177354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:10.177354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:10.177354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:10.177354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 189/384] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:10.177582 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.217081 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4034b6-2a49-4f85-831b-d68b67c3232e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.239604 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.254737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bb6b1-0add-49ce-aa0a-b5bebc8af911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.255388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bb6b1-0add-49ce-aa0a-b5bebc8af911 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.255667 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bb6b1-0add-49ce-aa0a-b5bebc8af911 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.255940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bb6b1-0add-49ce-aa0a-b5bebc8af911 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.257100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.267552 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bb6b1-0add-49ce-aa0a-b5bebc8af911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-bb4bb6b1-0add-49ce-aa0a-b5bebc8af911 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:10.273644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:10.274526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 196/385] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:10.280754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bb6b1-0add-49ce-aa0a-b5bebc8af911 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.296621 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0a6d8-3aa9-4211-b5f3-3e3db8e112e7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.335585 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.336426 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.336533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.336742 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.344498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.345936 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:10.357580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:10.358638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 190/386] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:10.359547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.386709 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bb6b1-0add-49ce-aa0a-b5bebc8af911 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.420555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.421173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.421447 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.421717 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.431713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.433199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:10.448149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:10.449211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:10.450084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:10.450084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:10.450084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:10.450084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 197/387] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:10.450295 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.464122 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1902f-daf0-4341-8c38-5f484882609a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.483126 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.493869 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.499537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.500130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.500403 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.500672 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.501308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:10.501610 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.502964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.515672 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 191/388] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:10.516464 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.551446 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93aeb-8b74-497e-8008-1f69484816b1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.584180 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.584791 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.585065 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.585332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.585984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:10.586276 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.587662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.595545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 198/389] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:10.596308 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.616265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875377e8-ee69-4c97-bfe4-e43798dd1cd8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.650235 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.650842 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.651180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.651483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.652227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:10.652557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.654008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.688742 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 192/390] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:10.689554 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.690185 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.698214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0de9ae-5aa8-4119-9ff1-8a38a5402617 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.730695 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.731346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.731627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.731896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.741767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.742733 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.744345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:10.759103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:10.760025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:10.761030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:10.761030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:10.761030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:10.761030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 199/391] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:10.761466 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.795208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a6d5f-a640-4aa0-bc86-f175540338ce None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.829343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.829947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.830226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.830497 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.831138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:10.831471 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.832924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.847362 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 193/392] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:10.848209 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.868482 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9d02-bc57-4298-88c9-054f0bd98286 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.901932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.902606 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.902881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.903151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.910915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.912363 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:10.924387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:10.925285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 200/393] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:10.926770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:10.939313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.950691 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20f22-81f4-442d-b918-7e3c9866e6c1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:10.961890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:10.985370 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:10.985992 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:10.986267 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:10.986538 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:10.997109 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:10.998561 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:11.013662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:11.014555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:11.015421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:11.015421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:11.015421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:11.015421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 194/394] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:11.015649 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.030251 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ececd4-7ed6-497a-b17f-faa2798be49a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.063363 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.063981 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.064257 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.064526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.075222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.076694 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:11.090817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:11.091829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:11.092679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:11.092679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:11.092679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:11.096598 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 201/395] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:11.097296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.121070 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648b312-e778-4f9f-9873-5a24c1cf98a2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.154161 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.154748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.155023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.155125 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:11.155322 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.155946 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:11.156243 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.157839 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.169502 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 195/396] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:11.170111 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.193851 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:11.199590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261294b5-8917-4f12-93ee-f3e93932a043 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.232760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.233367 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.233641 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.233909 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.242146 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.243610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:11.255623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:11.256675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:11.257576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 202/397] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:11.258050 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.270220 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be896f4-b83a-4744-b34d-9fa9917341a6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.305873 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.306473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.306748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.307015 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.307769 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:11.308071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.309491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.327226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 196/398] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:11.328138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.356543 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d269b1-27f7-463b-b75b-1b3803162d4f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.373500 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:11.390774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.391392 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.391664 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.391930 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.392554 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:11.392854 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.394201 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.405700 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 203/399] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:11.406266 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.411231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:11.430828 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa182c92-c5e1-454e-b8f7-7e13cc8de743 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.464621 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.465253 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.465534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.465802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.466445 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:11.466760 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.468187 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.479168 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 197/400] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:11.479983 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.509409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f432d-6dc1-43a3-896e-11ecb9f432e1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.542076 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc21951-45d7-413c-bd7c-25bb0662eb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.542663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21951-45d7-413c-bd7c-25bb0662eb54 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.542939 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21951-45d7-413c-bd7c-25bb0662eb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.543207 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21951-45d7-413c-bd7c-25bb0662eb54 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.543870 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc21951-45d7-413c-bd7c-25bb0662eb54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.545276 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc21951-45d7-413c-bd7c-25bb0662eb54 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.566668 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 204/401] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:28:11 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:11.567825 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc21951-45d7-413c-bd7c-25bb0662eb54 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.590523 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b4e6-6a21-4abb-a98b-1a2dd68f357b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.605703 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:11.633323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.633847 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.634129 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.634397 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.635228 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:11.635572 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.637031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.653548 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:11.659425 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 198/402] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:11.660311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.683974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc21951-45d7-413c-bd7c-25bb0662eb54 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.724408 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.725053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.725327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.725593 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.737616 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.739120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:11.755685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:11.756645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:11.763123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:11.763123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:11.763123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:11.763123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 205/403] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:11.763123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.779684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f470e-014c-48d7-abcc-2404bad73df3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.813606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.814230 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.814502 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.814767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.824456 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.826677 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:11.843881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:11.844802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:11.845692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 199/404] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:11.846247 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.858590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:11.875371 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce667da-43d0-45ea-97f1-c2f4f193b8c3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.911201 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:11.913616 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.914408 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:11.915043 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:11.915350 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:11.922865 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:11.924349 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:11.936222 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:11.937097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:11.937969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:11.937969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:11.937969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:11.937969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:11.937969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:11.937969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:11.937969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:11.937969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:11.942046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 206/405] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:11.943137 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:11.959584 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afda6a-4a4e-4e1c-9cc0-7637d61f0b46 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:11.999213 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763bac3-ec0d-444f-be07-849cc86c8ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:11.999876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763bac3-ec0d-444f-be07-849cc86c8ed8 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.000239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763bac3-ec0d-444f-be07-849cc86c8ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.000459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763bac3-ec0d-444f-be07-849cc86c8ed8 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/f7ca69834de848d1a3cbbeb63c6a0645/roles/2954c0a9ecde4a92a2e278db491ab7f9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.015621 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763bac3-ec0d-444f-be07-849cc86c8ed8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=f7ca69834de848d1a3cbbeb63c6a0645, role_id=2954c0a9ecde4a92a2e278db491ab7f9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.017083 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763bac3-ec0d-444f-be07-849cc86c8ed8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.038288 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 200/406] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:11 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/f7ca69834de848d1a3cbbeb63c6a0645/roles/2954c0a9ecde4a92a2e278db491ab7f9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:12.038288 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763bac3-ec0d-444f-be07-849cc86c8ed8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.058402 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b340-1c6f-4198-a292-2cbdd31037ec None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.099511 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.100239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.100516 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.100792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.101445 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:12.101748 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.103150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.124871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 207/407] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:12.125860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.138544 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:12.164853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763bac3-ec0d-444f-be07-849cc86c8ed8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.202865 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:12.206652 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.207287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.209621 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.209903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.210761 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:12.211068 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.213157 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.235910 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 201/408] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Oct 18 11:28:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:12.236764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.253916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de33b8-5f18-4256-82bf-89ddebbe0681 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.295525 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.296788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.297539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.298009 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.298886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:12.299389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.300980 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.323321 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 208/409] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:12.325181 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.371586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd112a5-e5da-4c3e-b351-549812bd17ba None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.402620 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:12.421111 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.421657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.421929 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.422195 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.432022 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.434325 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.449150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf5a7-66b6-4eff-a88f-ad6cc510478b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:12.452333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:12.453173 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:12.454025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:12.454025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:12.454025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:12.454025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:12.454025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:12.454025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:12.454025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:12.454025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:12.461722 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 202/410] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:12.461722 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.490314 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:12.504963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.506827 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.507405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.507887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.526804 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.529551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:12.550061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:12.551027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:12.552619 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:12.552619 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:12.552619 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:12.559563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 209/411] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:12.559563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.581903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59eac3d-c537-42be-8834-24e0686a9274 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.617927 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cb1c1-8761-4097-85d8-f832e21504d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.618853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cb1c1-8761-4097-85d8-f832e21504d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.619313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cb1c1-8761-4097-85d8-f832e21504d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.619730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cb1c1-8761-4097-85d8-f832e21504d6 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/0a286777ff794c7a973a07881c195de1/roles/2954c0a9ecde4a92a2e278db491ab7f9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.635224 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cb1c1-8761-4097-85d8-f832e21504d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=0a286777ff794c7a973a07881c195de1, role_id=2954c0a9ecde4a92a2e278db491ab7f9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.636941 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889cb1c1-8761-4097-85d8-f832e21504d6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.652095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 203/412] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:12 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/0a286777ff794c7a973a07881c195de1/roles/2954c0a9ecde4a92a2e278db491ab7f9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:12.653265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cb1c1-8761-4097-85d8-f832e21504d6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.678435 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ab038-3293-4abb-b296-befaf9fe97e6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.698741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:12.719932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.720556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.720827 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.721094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.721891 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:12.722194 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.724390 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.738128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 210/413] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:12.749017 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.752049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:12.807572 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cb1c1-8761-4097-85d8-f832e21504d6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.889338 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.890286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.890702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.891112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:12.892033 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:12.892478 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:12.894132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:12.920028 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 204/414] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:12.922403 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61d560-2f89-4c82-bddf-f35d18239cf8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:12.925890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:12.987861 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d7cba-9369-48b4-90bd-09039a360a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:12.991324 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d7cba-9369-48b4-90bd-09039a360a9f None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:12.991611 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d7cba-9369-48b4-90bd-09039a360a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:12.991884 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d7cba-9369-48b4-90bd-09039a360a9f None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/676b9d7241084e86b41d982484363d24/roles/2954c0a9ecde4a92a2e278db491ab7f9` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:13.022317 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d7cba-9369-48b4-90bd-09039a360a9f None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=676b9d7241084e86b41d982484363d24, role_id=2954c0a9ecde4a92a2e278db491ab7f9)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:13.023784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d7cba-9369-48b4-90bd-09039a360a9f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:13.046334 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 211/415] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:12 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/676b9d7241084e86b41d982484363d24/roles/2954c0a9ecde4a92a2e278db491ab7f9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:13.091312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791b7b0-5338-40f1-812a-81a5542e96f5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:13.149810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:13.150728 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:13.151153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:13.151592 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:13.165160 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:13.166887 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:13.171277 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:13.183135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:13.184155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:13.185218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:13.185218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:13.185218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:13.185218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:13.185218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:13.185218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:13.185218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:13.185218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:13.187190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 205/416] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:13.193476 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d7cba-9369-48b4-90bd-09039a360a9f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:13.255268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:13.353409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d7cba-9369-48b4-90bd-09039a360a9f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:13.397258 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c1d0d-8ec5-4067-8805-a8cbe0d04793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:13.397863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1d0d-8ec5-4067-8805-a8cbe0d04793 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:13.398137 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1d0d-8ec5-4067-8805-a8cbe0d04793 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:13.398405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1d0d-8ec5-4067-8805-a8cbe0d04793 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:13.399085 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c1d0d-8ec5-4067-8805-a8cbe0d04793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:13.399408 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c1d0d-8ec5-4067-8805-a8cbe0d04793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:13.400808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c1d0d-8ec5-4067-8805-a8cbe0d04793 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:13.422752 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 212/417] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:13.428703 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:13.573952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca9ea3-ec25-4059-b82d-13d5cfd35e94 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:13.618685 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adaa19-1044-4862-936a-26a196a028d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:13.619373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adaa19-1044-4862-936a-26a196a028d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:13.619650 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adaa19-1044-4862-936a-26a196a028d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:13.619918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adaa19-1044-4862-936a-26a196a028d9 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/c2572ace3a9f4b929f38c8d74ee3faa9/roles/2954c0a9ecde4a92a2e278db491ab7f9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:13.635182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adaa19-1044-4862-936a-26a196a028d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=c2572ace3a9f4b929f38c8d74ee3faa9, role_id=2954c0a9ecde4a92a2e278db491ab7f9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:13.636660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5adaa19-1044-4862-936a-26a196a028d9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:13.653710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 206/418] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:13 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/c2572ace3a9f4b929f38c8d74ee3faa9/roles/2954c0a9ecde4a92a2e278db491ab7f9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:14.032559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a8bf-9d3e-470e-a042-005a02eec488 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:14.033059 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a8bf-9d3e-470e-a042-005a02eec488 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:14.033162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2a8bf-9d3e-470e-a042-005a02eec488 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:14.034559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 213/419] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:14.040370 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ac3f2-a3b2-4d3f-97d9-3bfc2f63426d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:14.040650 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ac3f2-a3b2-4d3f-97d9-3bfc2f63426d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:14.040921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ac3f2-a3b2-4d3f-97d9-3bfc2f63426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:14.064229 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e18ac3f2-a3b2-4d3f-97d9-3bfc2f63426d None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:14.065410 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e18ac3f2-a3b2-4d3f-97d9-3bfc2f63426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:14.119211 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:14.153354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 207/420] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:14.572237 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2a8bf-9d3e-470e-a042-005a02eec488 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:14.631729 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b277-5110-4d61-8972-8a958572bc27 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:14.632019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b277-5110-4d61-8972-8a958572bc27 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:14.632272 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b277-5110-4d61-8972-8a958572bc27 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:14.633869 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 208/421] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:14.669802 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583b77d-0311-4e76-bf14-cc06b1901264 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:14.670404 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583b77d-0311-4e76-bf14-cc06b1901264 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:14.670899 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583b77d-0311-4e76-bf14-cc06b1901264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:14.680634 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:14.697561 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2a8bf-9d3e-470e-a042-005a02eec488 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:14.704081 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3583b77d-0311-4e76-bf14-cc06b1901264 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:14.705256 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3583b77d-0311-4e76-bf14-cc06b1901264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:14.767453 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37656e7-2089-42a0-bae5-0ce38bf2057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:14.768098 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37656e7-2089-42a0-bae5-0ce38bf2057a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:14.768378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37656e7-2089-42a0-bae5-0ce38bf2057a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:14.768650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37656e7-2089-42a0-bae5-0ce38bf2057a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:14.792153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37656e7-2089-42a0-bae5-0ce38bf2057a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c37656e7-2089-42a0-bae5-0ce38bf2057a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:14.797042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:14.797926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:14.799112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 214/422] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:14.812859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37656e7-2089-42a0-bae5-0ce38bf2057a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:14.854138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 209/423] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:14.940633 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37656e7-2089-42a0-bae5-0ce38bf2057a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:14.976262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:14.976860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:14.977138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:14.977411 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:14.978064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:14.978362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:14.979755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:14.988035 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 215/424] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:14.994331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583b77d-0311-4e76-bf14-cc06b1901264 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:15.097485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583b77d-0311-4e76-bf14-cc06b1901264 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:15.107475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:15.133635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:15.134366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.134524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.134786 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.145217 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:15.146706 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:15.162335 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:15.164580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:15.166715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:15.166715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:15.166715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:15.166715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 210/425] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:15.169279 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:15.195628 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:15.275534 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0500539-c449-4647-b3f5-8dfff263a107 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:15.313890 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:15.314504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.314785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.315059 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.315735 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:15.316048 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:15.327287 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:15.335578 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 216/426] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:15.337600 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:15.358332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:15.463174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:15.484973 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49871b2c-7c05-4a22-8781-0e2e9735cb3b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:15.498590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62b265-1b3f-4d70-9687-1669aef35fda None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:15.520709 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e190e9-2eac-426b-86f8-d8b2262c3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:15.521336 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e190e9-2eac-426b-86f8-d8b2262c3819 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.521614 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e190e9-2eac-426b-86f8-d8b2262c3819 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.521886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e190e9-2eac-426b-86f8-d8b2262c3819 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.529570 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e190e9-2eac-426b-86f8-d8b2262c3819 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:15.531016 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e190e9-2eac-426b-86f8-d8b2262c3819 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:15.538092 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d7f7e-e31e-41a1-8020-c0b75e9f5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:15.538956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d7f7e-e31e-41a1-8020-c0b75e9f5e8f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.539463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d7f7e-e31e-41a1-8020-c0b75e9f5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.539909 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d7f7e-e31e-41a1-8020-c0b75e9f5e8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-94e190e9-2eac-426b-86f8-d8b2262c3819 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:15.543452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:15.544324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:15.545210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 211/427] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:15.545772 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec60167-abcf-4208-bc3b-27c019555b42 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.545957 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec60167-abcf-4208-bc3b-27c019555b42 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.546196 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec60167-abcf-4208-bc3b-27c019555b42 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.556810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 212/428] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:15.556810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec60167-abcf-4208-bc3b-27c019555b42 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:15.559728 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d7f7e-e31e-41a1-8020-c0b75e9f5e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-684d7f7e-e31e-41a1-8020-c0b75e9f5e8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:15.564978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:15.565868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:15.566734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:15.569509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 217/429] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:15.571081 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dacb4-1aff-4b31-a13f-2ce2bf94bdac None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.571551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dacb4-1aff-4b31-a13f-2ce2bf94bdac None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.571966 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dacb4-1aff-4b31-a13f-2ce2bf94bdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.577178 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:15.593591 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9a7dacb4-1aff-4b31-a13f-2ce2bf94bdac None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:15.595020 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9a7dacb4-1aff-4b31-a13f-2ce2bf94bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:15.659850 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec60167-abcf-4208-bc3b-27c019555b42 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:15.675604 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 218/430] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:15.677539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dacb4-1aff-4b31-a13f-2ce2bf94bdac None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:15.697474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:15.698087 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.698366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.698641 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.699416 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:15.702546 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:15.702546 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:15.720415 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 213/431] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 18 11:28:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:15.726200 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:15.796314 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:15.813602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:15.845811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dee28-e8ec-40d5-8c9b-70f9cd53e8df None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:15.860185 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dacb4-1aff-4b31-a13f-2ce2bf94bdac None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:15.882972 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994689-bdad-42c6-9912-f949af28d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:15.883638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994689-bdad-42c6-9912-f949af28d1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.883918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994689-bdad-42c6-9912-f949af28d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.884189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994689-bdad-42c6-9912-f949af28d1b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.894866 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b994689-bdad-42c6-9912-f949af28d1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:15.896861 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b994689-bdad-42c6-9912-f949af28d1b7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8b994689-bdad-42c6-9912-f949af28d1b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:15.913579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:15.914514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:15.915420 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:15.915420 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:15.915420 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:15.915420 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 214/432] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:15.919887 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308725c5-13fd-4e5c-8934-af8d2a099878 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.920167 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308725c5-13fd-4e5c-8934-af8d2a099878 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.920439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308725c5-13fd-4e5c-8934-af8d2a099878 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.921730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 215/433] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:15.922438 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308725c5-13fd-4e5c-8934-af8d2a099878 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:15.927410 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f1bf2-6ddf-4405-b9f1-bf6caf547618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:15.928742 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1bf2-6ddf-4405-b9f1-bf6caf547618 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.928742 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1bf2-6ddf-4405-b9f1-bf6caf547618 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.928742 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1bf2-6ddf-4405-b9f1-bf6caf547618 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.929353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f1bf2-6ddf-4405-b9f1-bf6caf547618 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:15.929653 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f1bf2-6ddf-4405-b9f1-bf6caf547618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:15.931076 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f1bf2-6ddf-4405-b9f1-bf6caf547618 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:15.942293 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 219/434] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:15.943243 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe480-377a-4dbc-82a2-4cf2615258c6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:15.943575 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe480-377a-4dbc-82a2-4cf2615258c6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:15.943846 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fe480-377a-4dbc-82a2-4cf2615258c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:15.964147 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1f1fe480-377a-4dbc-82a2-4cf2615258c6 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:15.965339 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1f1fe480-377a-4dbc-82a2-4cf2615258c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:16.037298 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308725c5-13fd-4e5c-8934-af8d2a099878 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.039367 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 220/435] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:16.041030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fe480-377a-4dbc-82a2-4cf2615258c6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.067714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:16.074259 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.075170 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.075682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.076152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.077011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:16.077526 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.079157 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.091833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 216/436] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:16.097323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.099068 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:16.164141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fe480-377a-4dbc-82a2-4cf2615258c6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.208962 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.209609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.209881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.210512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.217183 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4de50-d3c2-4512-84a8-742ee77bee7f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.223752 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.225391 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:16.242807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:16.243851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:16.244878 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:16.244878 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:16.244878 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:16.244878 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 221/437] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:16.245876 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.259546 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7b2d-3fda-428c-a1ce-6e2150fd2b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.260466 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7b2d-3fda-428c-a1ce-6e2150fd2b3a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.260917 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7b2d-3fda-428c-a1ce-6e2150fd2b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.261359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b7b2d-3fda-428c-a1ce-6e2150fd2b3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.272938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b7b2d-3fda-428c-a1ce-6e2150fd2b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0b7b7b2d-3fda-428c-a1ce-6e2150fd2b3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:16.278380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:16.279271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:16.280093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:16.282333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 217/438] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:16.288409 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7b2d-3fda-428c-a1ce-6e2150fd2b3a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.341063 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:16.355485 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d8c72-3c4e-458a-a6e2-e453b4bfc829 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.357746 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:16.390109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.390735 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.391010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.391312 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.392938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b7b2d-3fda-428c-a1ce-6e2150fd2b3a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.398539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.400011 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:16.411806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:16.412649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:16.413488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 222/439] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:16.414517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.430942 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff4052-2bef-4a1e-b3af-15b855c320b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.431578 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4052-2bef-4a1e-b3af-15b855c320b4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.431859 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4052-2bef-4a1e-b3af-15b855c320b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.432126 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff4052-2bef-4a1e-b3af-15b855c320b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.432769 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff4052-2bef-4a1e-b3af-15b855c320b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:16.433066 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff4052-2bef-4a1e-b3af-15b855c320b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.434430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff4052-2bef-4a1e-b3af-15b855c320b4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.446060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 218/440] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:16.446060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcbc7f-559f-4953-85f9-21d87a0af492 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.446060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcbc7f-559f-4953-85f9-21d87a0af492 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.446060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcbc7f-559f-4953-85f9-21d87a0af492 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.446060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 219/441] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:16.446060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcbc7f-559f-4953-85f9-21d87a0af492 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.513130 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd5c29-0ec9-4f08-a04e-2b51fb10fe19 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.545547 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.546138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.546418 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.546691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.547382 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:16.547683 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.549044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.550405 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcbc7f-559f-4953-85f9-21d87a0af492 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.557603 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 223/442] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:16.558382 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.563235 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:16.585342 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:16.587145 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a05f74-e112-47b9-b29a-14f039efdbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.587892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05f74-e112-47b9-b29a-14f039efdbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.588188 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05f74-e112-47b9-b29a-14f039efdbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.588473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05f74-e112-47b9-b29a-14f039efdbb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.598836 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a05f74-e112-47b9-b29a-14f039efdbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-15a05f74-e112-47b9-b29a-14f039efdbb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:16.603690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:16.604615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:16.605407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 220/443] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:16.606278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a05f74-e112-47b9-b29a-14f039efdbb1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.661737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc7f01-c54b-4de4-875a-3f3f6d923a1b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.696623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d773507-77c4-42dc-baa6-3dd4b166ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.697142 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d773507-77c4-42dc-baa6-3dd4b166ab91 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.697414 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d773507-77c4-42dc-baa6-3dd4b166ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.697687 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d773507-77c4-42dc-baa6-3dd4b166ab91 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.698356 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d773507-77c4-42dc-baa6-3dd4b166ab91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:16.698652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d773507-77c4-42dc-baa6-3dd4b166ab91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.700093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d773507-77c4-42dc-baa6-3dd4b166ab91 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.703841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a05f74-e112-47b9-b29a-14f039efdbb1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.712361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 224/444] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:16.713591 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab244a-27e7-4e06-8821-9ad8d32aed87 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.713870 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab244a-27e7-4e06-8821-9ad8d32aed87 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.714138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab244a-27e7-4e06-8821-9ad8d32aed87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.731455 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c2ab244a-27e7-4e06-8821-9ad8d32aed87 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:16.732621 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c2ab244a-27e7-4e06-8821-9ad8d32aed87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:16.737448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.738066 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.738343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.739313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.746232 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.747708 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:16.759844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:16.760784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 221/445] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:16.761658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.793890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:16.803819 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 225/446] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:16.804648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab244a-27e7-4e06-8821-9ad8d32aed87 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.821697 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:16.880969 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4370d-0161-4243-af2d-477489907d43 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.914703 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.915103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab244a-27e7-4e06-8821-9ad8d32aed87 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:16.915458 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.915732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.915998 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.926816 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.928274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:16.945355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:16.946364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:16.947246 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:16.947246 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:16.947246 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:16.951384 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 222/447] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:16.952528 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:16.956337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:16.956942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:16.957282 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:16.957682 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:16.958347 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:16.958648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:16.960034 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:16.972650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 226/448] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:16.972650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.045017 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:17.058064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:17.064908 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76819e-c88b-4125-9048-2f9d68907a94 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.080960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fff1f-7c5d-4a44-adec-afd7bc27e84e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.099854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298d75e-3caa-45fa-a04b-d31ec2858d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.100505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d75e-3caa-45fa-a04b-d31ec2858d57 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.100779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d75e-3caa-45fa-a04b-d31ec2858d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.101049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298d75e-3caa-45fa-a04b-d31ec2858d57 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/ba0cf1bee1f5484992f924d93251a583/roles/2954c0a9ecde4a92a2e278db491ab7f9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.115564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298d75e-3caa-45fa-a04b-d31ec2858d57 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=ba0cf1bee1f5484992f924d93251a583, role_id=2954c0a9ecde4a92a2e278db491ab7f9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.116855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.116985 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298d75e-3caa-45fa-a04b-d31ec2858d57 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.117447 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.117717 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.117980 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.118687 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:17.118983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.120384 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.129711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 223/449] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:16 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/ba0cf1bee1f5484992f924d93251a583/roles/2954c0a9ecde4a92a2e278db491ab7f9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:17.130541 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298d75e-3caa-45fa-a04b-d31ec2858d57 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.138851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 227/450] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 18 11:28:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:17.140108 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.251717 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298d75e-3caa-45fa-a04b-d31ec2858d57 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.262431 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477c733-3ad2-4290-b0e4-1b95f8d9f31d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.284488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:17.291787 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.292666 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.293179 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.293451 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.294096 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:17.294390 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.295946 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.305155 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.305155 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.305155 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.305490 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.309443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 224/451] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:17.312769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:17.312905 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.322290 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.323820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:17.340889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:17.342016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:17.342856 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:17.342856 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:17.342856 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:17.342856 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 228/452] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:17.343157 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.424306 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cf3c6-858f-42aa-b0d3-a5ef7939b2f0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.453311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f37937-beb7-40ab-9937-4df3bbfd38a4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.458300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89d94d-885b-47a2-9af0-640b77e55a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.458930 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89d94d-885b-47a2-9af0-640b77e55a85 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.459191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89d94d-885b-47a2-9af0-640b77e55a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.459477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89d94d-885b-47a2-9af0-640b77e55a85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.469565 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89d94d-885b-47a2-9af0-640b77e55a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-bd89d94d-885b-47a2-9af0-640b77e55a85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:17.474736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:17.475764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:17.476558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 225/453] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:17.477201 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89d94d-885b-47a2-9af0-640b77e55a85 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.497094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5f892-c5ac-46dc-a06b-fe21e84bc01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.497711 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5f892-c5ac-46dc-a06b-fe21e84bc01f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.497986 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5f892-c5ac-46dc-a06b-fe21e84bc01f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.498255 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5f892-c5ac-46dc-a06b-fe21e84bc01f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.533864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:17.559593 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:17.575541 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5f892-c5ac-46dc-a06b-fe21e84bc01f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.576992 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5f892-c5ac-46dc-a06b-fe21e84bc01f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.585884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89d94d-885b-47a2-9af0-640b77e55a85 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.625788 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.626425 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.626675 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.626942 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.635808 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.637262 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:17.648574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:17.649485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 226/454] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:17.650385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.696773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 229/455] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:28:17.696773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5f892-c5ac-46dc-a06b-fe21e84bc01f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.761735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae6b18-8ac2-4f34-9171-913549644d29 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.776088 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:17.785415 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:17.799383 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5f892-c5ac-46dc-a06b-fe21e84bc01f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.799730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.800332 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.800609 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.800926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.801566 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:17.801871 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.803233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.815664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 227/456] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:17.821136 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.835871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.836563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.836904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.837235 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.837953 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:17.838319 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.839920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.853350 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 230/457] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:17.853350 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:17.936007 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457464b-dd60-4eb2-87d2-61d07849b964 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.961910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eeb13-f8f9-45c0-a749-2e0a5c417f65 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:17.969684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:17.970274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:17.970544 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:17.970811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:17.971557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:17.971859 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:17.973826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:17.990891 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 228/458] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:17.991708 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.007921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.008544 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.008820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.009090 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.021218 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.022666 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.025311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:18.040830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:18.041942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:18.042924 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:18.042924 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:18.042924 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:18.043550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 231/459] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:18.044371 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.047465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.105548 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fecb14-dd2a-4865-a28d-8c698b118003 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.140685 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.141549 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.141549 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.141836 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.149052 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.150437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d83cc-8185-464a-a7c8-73a648365481 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.150547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:18.162382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:18.163366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:18.164704 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 229/460] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:18.168778 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.189153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.189795 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.190068 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.190335 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.201751 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.203182 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:18.218623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:18.219538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:18.220388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:18.220388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:18.220388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:18.220388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 232/461] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:18.220597 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.266741 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.277758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43151fa-1487-4ae8-b0b2-2e6b53c83366 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.281144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.313514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8a194-8661-413b-a28b-8b037c693f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.314028 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8a194-8661-413b-a28b-8b037c693f16 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.314304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8a194-8661-413b-a28b-8b037c693f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.314573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8a194-8661-413b-a28b-8b037c693f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.330837 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137d8f1-fe94-436b-bd02-e563d70fc268 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.368757 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.369672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.370014 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.370345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.371051 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:18.371445 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.372793 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.383728 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8a194-8661-413b-a28b-8b037c693f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.385288 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8a194-8661-413b-a28b-8b037c693f16 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.390412 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 233/462] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:18.390412 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.481734 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.492941 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 230/463] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:28:18.493845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8a194-8661-413b-a28b-8b037c693f16 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.506301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bc5c7-c369-4303-bd73-9f1f913628ac None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.522146 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.543955 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.544553 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.544820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.545084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.545796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:18.546103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.547541 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.566468 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 234/464] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:18.568002 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.608261 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8a194-8661-413b-a28b-8b037c693f16 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.642696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.643305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.643586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.643853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.644481 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:18.644879 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.646277 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.657846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 231/465] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:18.658427 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.677829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168fff3-779d-41a0-9ed7-6283301352e3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.710011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.715828 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.716629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.717006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.717381 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.725390 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.727053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:18.738507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:18.739940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 235/466] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:18.746120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.770573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2b307-8d83-4875-8ae4-0c136e9a1733 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.777206 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.806864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.807272 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.807575 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.807915 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.819809 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.821210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:18.841897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:18.842830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:18.844206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:18.844206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:18.844206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:18.844206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 232/467] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:18.844206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:18.858093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0ca3-50a5-479c-8db8-0b3175a4913d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.896008 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c3d72-17a3-423a-8afb-60159fe5bc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.896607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c3d72-17a3-423a-8afb-60159fe5bc66 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.896886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c3d72-17a3-423a-8afb-60159fe5bc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.897154 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c3d72-17a3-423a-8afb-60159fe5bc66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.953678 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24089f2-6b3c-47ee-ab2e-b41169a289cc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:18.955221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:18.967463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c3d72-17a3-423a-8afb-60159fe5bc66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:18.969157 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c3d72-17a3-423a-8afb-60159fe5bc66 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:18.991043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:18.991699 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:18.991981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:18.992250 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:18.999717 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:19.001881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.003534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:19.015943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:19.016919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 233/468] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:19.017811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.083550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 236/469] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:28:19.083550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c3d72-17a3-423a-8afb-60159fe5bc66 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.132422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc97b0-ac75-40c4-b307-3286e56b77b9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:19.167189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:19.167818 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.168098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.168364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.169059 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:19.169375 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.170861 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.183692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 234/470] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:19.184641 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.198481 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c3d72-17a3-423a-8afb-60159fe5bc66 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:19.210463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:19.232691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:19.239768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:19.240556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.240837 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.241105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.241758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:19.242062 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.243488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.256590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 237/471] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:19.257320 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.302233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c74db6-77b3-4725-90a7-f30e88bdc272 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:19.337402 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:19.337921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.338197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.338467 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.339186 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:19.339531 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.340960 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.358449 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 235/472] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:19.359369 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.365891 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baff6bf-4165-446c-ae0f-d3e063d3379a None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:19.400120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:19.401148 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.401430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.401704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.413173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.414601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:19.428960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:19.429974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:19.430813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:19.430813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:19.430813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:19.430813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 238/473] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:19.430813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.443162 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:19.461850 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abc91-6bd7-4264-bf99-fc9f3b064928 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:19.477873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:19.496951 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d817d-cfde-48a0-8524-226f43925856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:19.497641 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d817d-cfde-48a0-8524-226f43925856 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.497983 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d817d-cfde-48a0-8524-226f43925856 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.498347 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d817d-cfde-48a0-8524-226f43925856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.499095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d817d-cfde-48a0-8524-226f43925856 None admin] RBAC: Adding query filter params (role.id=2954c0a9ecde4a92a2e278db491ab7f9, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=f7ca69834de848d1a3cbbeb63c6a0645) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:19.499435 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d817d-cfde-48a0-8524-226f43925856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.500853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d817d-cfde-48a0-8524-226f43925856 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.507238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 236/474] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/role_assignments?user.id=f7ca69834de848d1a3cbbeb63c6a0645&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=2954c0a9ecde4a92a2e278db491ab7f9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:19.508428 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b2f8-14df-401e-8f12-bec9dca13fa3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.508712 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b2f8-14df-401e-8f12-bec9dca13fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.508985 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b2f8-14df-401e-8f12-bec9dca13fa3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.510341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 237/475] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:19.510885 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1b2f8-14df-401e-8f12-bec9dca13fa3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.546281 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758b655-08ad-47ef-8d75-083f4def7dc2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:19.586410 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:19.587054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.587361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.588138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.595183 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.596704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:19.610042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:19.611003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:19.611901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 239/476] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:19.612364 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.648186 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1b2f8-14df-401e-8f12-bec9dca13fa3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:19.688184 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34038de2-1acb-40c2-8afd-e9903a5b09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:19.688789 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34038de2-1acb-40c2-8afd-e9903a5b09fe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.689079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34038de2-1acb-40c2-8afd-e9903a5b09fe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.689330 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34038de2-1acb-40c2-8afd-e9903a5b09fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.706349 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:19.733094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f5ecc-18e1-40cf-9319-a98c68965ae4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:19.735463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:19.766633 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34038de2-1acb-40c2-8afd-e9903a5b09fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.768352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34038de2-1acb-40c2-8afd-e9903a5b09fe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.775721 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb87e50-fb9d-45da-8607-cd75a7447ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:19.776427 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87e50-fb9d-45da-8607-cd75a7447ccd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.777118 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87e50-fb9d-45da-8607-cd75a7447ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.777392 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb87e50-fb9d-45da-8607-cd75a7447ccd None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.778028 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb87e50-fb9d-45da-8607-cd75a7447ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:19.778327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb87e50-fb9d-45da-8607-cd75a7447ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:19.780361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb87e50-fb9d-45da-8607-cd75a7447ccd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:19.793690 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 240/477] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:19.794984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d607-cdda-4b66-97f0-8fb3120cf477 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:19.795295 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d607-cdda-4b66-97f0-8fb3120cf477 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:19.795558 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6d607-cdda-4b66-97f0-8fb3120cf477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:19.814685 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c3e6d607-cdda-4b66-97f0-8fb3120cf477 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:19.816223 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c3e6d607-cdda-4b66-97f0-8fb3120cf477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:19.883153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 238/478] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:28:19.884134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34038de2-1acb-40c2-8afd-e9903a5b09fe None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.895729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 241/479] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:19.896756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d607-cdda-4b66-97f0-8fb3120cf477 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:19.947742 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:20.006984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:20.010378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34038de2-1acb-40c2-8afd-e9903a5b09fe None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.015381 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6d607-cdda-4b66-97f0-8fb3120cf477 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.047205 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.047853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.048137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.048408 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.049519 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:20.049843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.052067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.055509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.056411 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.056935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.057398 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.069381 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 239/480] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:20.069381 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.069629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.069629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:20.085906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:20.086813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:20.087803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:20.087803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:20.087803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:20.087803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:20.087803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:20.087803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:20.087803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:20.087803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:20.090442 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 242/481] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:20.091797 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.198793 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08286946-91db-4227-a818-f9b9433c3f97 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.201805 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:20.210009 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862841ee-5ed6-4814-8eec-62c15d0f145f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.237325 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.238125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.238397 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.239352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.246726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.247454 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.247731 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.248001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.248719 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] RBAC: Adding query filter params (role.id=2954c0a9ecde4a92a2e278db491ab7f9, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=0a286777ff794c7a973a07881c195de1) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:20.249021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.250429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.251504 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.253383 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.256959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 243/482] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/role_assignments?user.id=0a286777ff794c7a973a07881c195de1&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=2954c0a9ecde4a92a2e278db491ab7f9 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:20.257741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:20.283133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:20.284346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:20.286031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:20.286031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:20.286031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:20.291439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 240/483] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:20.291439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.298212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:20.396243 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f9498-2211-44f0-b062-afa45e5e377c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.414429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb61d59-9be5-43fd-a66c-650747216132 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.436031 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.436898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.437318 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.437744 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.438449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:20.438748 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.440236 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.455663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b3c02-0047-4c49-969e-2541784b4c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.455984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 244/484] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:20.456908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.457254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b3c02-0047-4c49-969e-2541784b4c31 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.458465 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b3c02-0047-4c49-969e-2541784b4c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.458941 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b3c02-0047-4c49-969e-2541784b4c31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.471436 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b3c02-0047-4c49-969e-2541784b4c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-636b3c02-0047-4c49-969e-2541784b4c31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:20.477821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:20.478779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:20.479707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:20.486985 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 241/485] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:20.488847 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b3c02-0047-4c49-969e-2541784b4c31 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.510132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:20.552499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:20.575800 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d60009-9f62-40e6-a655-0cbfcaf98081 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.605509 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b3c02-0047-4c49-969e-2541784b4c31 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.612417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.613240 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.614203 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.614597 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.615449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:20.615849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.617410 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.632194 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 245/486] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:20.633285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.642071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.642672 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.642942 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.643209 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.644070 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] RBAC: Adding query filter params (role.id=2954c0a9ecde4a92a2e278db491ab7f9, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=676b9d7241084e86b41d982484363d24) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:20.644372 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.646238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.657286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 242/487] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/role_assignments?user.id=676b9d7241084e86b41d982484363d24&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=2954c0a9ecde4a92a2e278db491ab7f9 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:20.657286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.810629 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:20.830582 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a5b47-eedf-4a07-97fe-4ae12e601d1c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.843794 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e02b-f6e4-47c3-b43b-084aea87fd74 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:20.884588 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.885228 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.885499 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.885769 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.894216 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.896617 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.897422 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:20.898577 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:20.899522 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:20.900001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:20.900862 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:20.901377 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:20.902927 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:20.909221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:20.910098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:20.911880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 243/488] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:20.913070 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:20.917707 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 246/489] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:20.918575 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:20.924754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:21.047089 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c6c4e-c00f-4e11-a59f-0d00e31861bc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:21.070380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9150c3-f008-4d08-8590-d28658c71958 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:21.090370 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:21.091338 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:21.091844 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:21.092566 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:21.093448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:21.094181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:21.096317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:21.107605 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:21.112429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 244/490] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:21.118543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:21.159542 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:21.160716 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:21.161000 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:21.161268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:21.190408 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:21.191939 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:21.221648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:21.222624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:21.224233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:21.224233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:21.224233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:21.235775 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 247/491] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:21.235775 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:21.260351 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3dcf4-08f5-4c8c-870a-ce8e06e9988b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:21.327172 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:21.328064 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:21.328560 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:21.329044 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:21.330002 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] RBAC: Adding query filter params (role.id=2954c0a9ecde4a92a2e278db491ab7f9, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=c2572ace3a9f4b929f38c8d74ee3faa9) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:21.330483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:21.332168 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:21.339373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 245/492] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:21 2022] GET /identity/v3/role_assignments?user.id=c2572ace3a9f4b929f38c8d74ee3faa9&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=2954c0a9ecde4a92a2e278db491ab7f9 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:21.343699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:21.435729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b7d15-b51a-47a5-aa7c-381a60b67fe6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:21.480158 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:21.480779 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:21.481059 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:21.481332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:21.481984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:21.482286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:21.483733 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:21.498020 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 248/493] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:21.504921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:21.590207 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:21.631014 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040549-7a9e-4311-867a-5f91d50e0177 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:21.666257 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:21.666878 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:21.667150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:21.667446 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:21.675170 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:21.676724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:21.690125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:21.691079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:21.692624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 246/494] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:21.697446 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:21.853308 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da818b4-ffe1-4b47-ab17-2a63d17e340c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:21.868752 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:21.891080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9c828-7954-488e-b928-09623c9932f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:21.891709 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c828-7954-488e-b928-09623c9932f3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:21.891986 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c828-7954-488e-b928-09623c9932f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:21.892259 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9c828-7954-488e-b928-09623c9932f3 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:21.892979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9c828-7954-488e-b928-09623c9932f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:21.893280 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9c828-7954-488e-b928-09623c9932f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:21.894833 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9c828-7954-488e-b928-09623c9932f3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:21.913128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 249/495] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 18 11:28:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:21.918461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:21.936336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ffd18-072d-455a-b587-5256d4f4c769 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:21.936638 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ffd18-072d-455a-b587-5256d4f4c769 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:21.936883 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ffd18-072d-455a-b587-5256d4f4c769 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:21.938447 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 250/496] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:28:21.943859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5335f5-d4bf-4f4f-ad1e-7f2d26da4871 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:21.944134 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5335f5-d4bf-4f4f-ad1e-7f2d26da4871 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:21.944403 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5335f5-d4bf-4f4f-ad1e-7f2d26da4871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:21.967936 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fc5335f5-d4bf-4f4f-ad1e-7f2d26da4871 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:21.969137 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fc5335f5-d4bf-4f4f-ad1e-7f2d26da4871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:22.042391 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 251/497] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:22.118937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579b5d-3010-4986-8491-851c491b03f5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:22.150679 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:22.167935 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7665b-c06f-45e5-87d2-85cbd36ac5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:22.168550 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7665b-c06f-45e5-87d2-85cbd36ac5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:22.168829 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7665b-c06f-45e5-87d2-85cbd36ac5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:22.169099 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7665b-c06f-45e5-87d2-85cbd36ac5a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:22.260311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7665b-c06f-45e5-87d2-85cbd36ac5a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:22.261780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7665b-c06f-45e5-87d2-85cbd36ac5a3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:22.366932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5335f5-d4bf-4f4f-ad1e-7f2d26da4871 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:22.393176 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 247/498] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 18 11:28:22.394244 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7665b-c06f-45e5-87d2-85cbd36ac5a3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:22.440783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:22.528570 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:22.532299 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5335f5-d4bf-4f4f-ad1e-7f2d26da4871 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:22.586592 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7665b-c06f-45e5-87d2-85cbd36ac5a3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:22.602893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:22.603645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:22.603924 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:22.604191 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:22.615586 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:22.617028 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:22.634313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:22.635288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:22.636159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:22.636159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:22.636159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:22.636159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 252/499] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:22.642745 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:22.664277 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:22.664833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:22.665108 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:22.665374 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:22.688408 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:22.690269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:22.724331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:22.725324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:22.726709 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:22.726709 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:22.726709 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:22.728797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 248/500] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:22.735603 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:22.826999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36cb69-74f1-4fc3-b070-7d6be25006ca None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:22.858934 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:22.885608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647504-be11-42f4-8677-be05bacf7702 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:22.916031 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:22.916982 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:22.917472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:22.917938 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:22.918784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:22.919296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:22.920899 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:22.926589 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:22.926589 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:22.926589 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:22.926589 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:22.927025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:22.927025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:22.927025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:22.946631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 253/502] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:22.946824 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 249/502] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:22.948255 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:22.952464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:22.981249 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:23.062564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc542e35-0b64-455e-a0c6-12b368fa7a07 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:23.099753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:23.100629 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.101049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.101529 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.104580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:23.109706 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:23.111417 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:23.123422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:23.124432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:23.125307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:23.125307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:23.125307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:23.125307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:23.125307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:23.125307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:23.125307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:23.125307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:23.131615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 250/503] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:23.134135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:23.165018 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3f0ca-747a-483c-b97b-b95022874402 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:23.201034 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3b69-8cf2-4b35-a591-50b3d02fc58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:23.201647 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3b69-8cf2-4b35-a591-50b3d02fc58d None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.202004 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3b69-8cf2-4b35-a591-50b3d02fc58d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.202344 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3b69-8cf2-4b35-a591-50b3d02fc58d None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.203153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3b69-8cf2-4b35-a591-50b3d02fc58d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:23.204773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3b69-8cf2-4b35-a591-50b3d02fc58d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:23.229041 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 254/504] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:28:22 2022] POST /identity/v3/users => generated 254 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:28:23.230493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4d54-38fd-4be8-84af-e543342df8ce None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.230940 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4d54-38fd-4be8-84af-e543342df8ce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.231358 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a4d54-38fd-4be8-84af-e543342df8ce None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.237468 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 255/505] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:23.239811 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192c19a-e877-4791-8ac2-800c8f94bb1d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.240168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192c19a-e877-4791-8ac2-800c8f94bb1d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.240555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192c19a-e877-4791-8ac2-800c8f94bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.244226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5405812-e039-444f-bef7-957b92f8fe01 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:23.260934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1192c19a-e877-4791-8ac2-800c8f94bb1d None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:23.262392 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1192c19a-e877-4791-8ac2-800c8f94bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:23.282779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:23.283850 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.284304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.284741 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.286424 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:23.286926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:23.288607 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:23.307229 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 251/506] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:23.310286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:23.342556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:23.349413 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 256/507] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:23.386402 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:23.433094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605810-08cc-47a8-8b79-f6beff8c2226 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:23.471051 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5d0c0-a060-443c-8e4f-fffe8928beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:23.472041 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5d0c0-a060-443c-8e4f-fffe8928beca None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.472574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5d0c0-a060-443c-8e4f-fffe8928beca None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.473786 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5d0c0-a060-443c-8e4f-fffe8928beca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.474881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5d0c0-a060-443c-8e4f-fffe8928beca None admin] RBAC: Adding query filter params (role.id=2954c0a9ecde4a92a2e278db491ab7f9, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=ba0cf1bee1f5484992f924d93251a583) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:23.475417 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5d0c0-a060-443c-8e4f-fffe8928beca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:23.477054 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5d0c0-a060-443c-8e4f-fffe8928beca None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:23.489888 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 252/508] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:23 2022] GET /identity/v3/role_assignments?user.id=ba0cf1bee1f5484992f924d93251a583&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=2954c0a9ecde4a92a2e278db491ab7f9 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:23.592558 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79e552-8509-40a3-a0f5-6778a32eaacd None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.593090 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79e552-8509-40a3-a0f5-6778a32eaacd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.593090 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79e552-8509-40a3-a0f5-6778a32eaacd None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.594624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 257/509] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:23.600163 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796e5b-1127-4b4a-b68d-240f0be3e884 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.601123 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796e5b-1127-4b4a-b68d-240f0be3e884 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.601668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796e5b-1127-4b4a-b68d-240f0be3e884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.621724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b5796e5b-1127-4b4a-b68d-240f0be3e884 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:23.623352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b5796e5b-1127-4b4a-b68d-240f0be3e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:23.646263 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79e552-8509-40a3-a0f5-6778a32eaacd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:23.710017 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 253/510] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:23.769987 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79e552-8509-40a3-a0f5-6778a32eaacd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:23.806295 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e981-5ce2-4717-9276-474cf41f9019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:23.806921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e981-5ce2-4717-9276-474cf41f9019 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:23.807196 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e981-5ce2-4717-9276-474cf41f9019 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:23.807495 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8e981-5ce2-4717-9276-474cf41f9019 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:23.819321 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8e981-5ce2-4717-9276-474cf41f9019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-71c8e981-5ce2-4717-9276-474cf41f9019 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:23.824128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:23.825042 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:23.825881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 258/511] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:23.840638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796e5b-1127-4b4a-b68d-240f0be3e884 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:23.915884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:23.991498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796e5b-1127-4b4a-b68d-240f0be3e884 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:24.011309 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e981-5ce2-4717-9276-474cf41f9019 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:24.040901 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:24.041430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.041708 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.041985 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.042640 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:24.042938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:24.044353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:24.065164 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 254/512] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:24.072011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:24.149498 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:24.190627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab6e9e-5559-4329-8194-f4aad773865c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:24.204125 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8e981-5ce2-4717-9276-474cf41f9019 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:24.205058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:24.230981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:24.231693 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.231965 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.232330 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.246202 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:24.248132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:24.248372 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81918ee-e46b-4780-95a7-7a07f5fe8ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:24.249008 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81918ee-e46b-4780-95a7-7a07f5fe8ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.249277 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81918ee-e46b-4780-95a7-7a07f5fe8ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.249593 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81918ee-e46b-4780-95a7-7a07f5fe8ff2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.250289 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81918ee-e46b-4780-95a7-7a07f5fe8ff2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:24.251856 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81918ee-e46b-4780-95a7-7a07f5fe8ff2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e81918ee-e46b-4780-95a7-7a07f5fe8ff2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:24.263677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:24.264701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:24.265530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 259/513] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 18 11:28:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:24.266311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:24.267125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:24.270617 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:24.270617 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:24.270617 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:24.270999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ddc79-b303-4126-a47a-1e675de9f8ed None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.270999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ddc79-b303-4126-a47a-1e675de9f8ed None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.270999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ddc79-b303-4126-a47a-1e675de9f8ed None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.271441 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 255/514] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:24.276320 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 260/515] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:24.280604 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ddc79-b303-4126-a47a-1e675de9f8ed None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:24.280792 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:24.405294 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c668369-ac5b-44e4-a272-6079879bbbc7 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:24.411930 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ddc79-b303-4126-a47a-1e675de9f8ed None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:24.438962 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:24.454393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004350ed-85ba-497e-aa95-6eb081adc6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:24.455293 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004350ed-85ba-497e-aa95-6eb081adc6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.455401 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:24.455879 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004350ed-85ba-497e-aa95-6eb081adc6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.456122 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.456461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.456669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004350ed-85ba-497e-aa95-6eb081adc6f6 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.456810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.457686 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004350ed-85ba-497e-aa95-6eb081adc6f6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:24.458151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004350ed-85ba-497e-aa95-6eb081adc6f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:24.458251 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:24.458615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:24.459996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004350ed-85ba-497e-aa95-6eb081adc6f6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:24.460163 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:24.469845 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 261/516] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 18 11:28:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:24.471413 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d751-4a8e-45aa-8ed8-3728abc761e2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.471933 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d751-4a8e-45aa-8ed8-3728abc761e2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.472304 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8d751-4a8e-45aa-8ed8-3728abc761e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.479586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 256/517] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:24.480819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:24.500385 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-79a8d751-4a8e-45aa-8ed8-3728abc761e2 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:24.501570 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-79a8d751-4a8e-45aa-8ed8-3728abc761e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:24.516109 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:24.595278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 262/518] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:24.595278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8d751-4a8e-45aa-8ed8-3728abc761e2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:24.642126 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c0bb5-12d8-490c-a53c-c9f007dcb384 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:24.734049 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8d751-4a8e-45aa-8ed8-3728abc761e2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:24.742614 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:24.743240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.743539 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.743812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.744445 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:24.744744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:24.746116 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:24.751935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:24.761385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 257/519] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 18 11:28:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:24.793036 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:24.793992 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:24.794439 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:24.794902 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:24.805657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:24.807121 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:24.832718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:24.833737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:24.834669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 263/520] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 18 11:28:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:24.843226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:24.923680 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:24.961403 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:24.983833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16a4e5-28d8-4f87-9fc1-c7fbbdeb1414 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:25.046715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:25.047235 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:25.047529 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:25.047797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:25.048511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:25.048806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:25.050231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:25.077590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 258/521] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 18 11:28:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:25.085812 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:25.135423 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966b8d7-8831-4a99-9864-1a5252881faa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:25.219957 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:25.220673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:25.220869 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:25.221155 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] PATH_INFO: `/v3/services/network` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:25.221720 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:25.223658 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:25.226164 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070a4f-9c1b-4638-95d6-e3660842dd2e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:25.244950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:25.245999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:25.246863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:25.252151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 264/522] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:24 2022] GET /identity/v3/services/network => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:25.268251 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:25.274181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:25.275137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:25.275656 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:25.276120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:25.288554 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:25.290430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:25.297792 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:25.308276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:25.309240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:25.310118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:25.310118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:25.310118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:25.312149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 259/523] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:25.318313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:25.389645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:25.439870 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdb707-b783-4a8a-8dbd-c2cb79a53043 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:25.480510 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:25.481491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:25.482042 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:25.482505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:25.483367 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:25.483906 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:25.485582 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:25.499266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 260/524] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:25.505938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:25.542202 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc383aa-8e86-4ab2-8aea-481f0a38d287 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:25.570726 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:25.600831 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:25.601515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:25.601704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:25.601971 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:25.602599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] RBAC: Adding query filter params (name=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:25.602894 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:25.604284 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:25.615007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 265/525] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:25.621281 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:25.664875 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dd192-4a20-4a8b-b8d8-6fcff1fa1fbf None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:25.757553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:25.758816 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:25.761799 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:25.762297 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:25.774132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:25.776956 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:25.785869 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c501-2715-4304-ae8b-bb18423f0985 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:25.793329 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:25.798061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:25.798919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:25.799841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:25.799841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:25.799841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:25.799841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:25.799841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:25.799841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:25.799841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:25.799841 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:25.807589 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 261/526] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:25.810965 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:25.889669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:25.890286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:25.890564 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:25.890834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:25.891487 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] RBAC: Adding query filter params (type=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:25.891790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:25.893143 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:25.906277 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 266/527] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:25.934895 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa7d6-9406-4e9c-88b8-14bebdb27965 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:25.958286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:25.981116 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49c907-6be0-479e-97a6-e8de8228af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:25.981793 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49c907-6be0-479e-97a6-e8de8228af31 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:25.982069 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49c907-6be0-479e-97a6-e8de8228af31 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:25.982368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49c907-6be0-479e-97a6-e8de8228af31 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:25.983138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49c907-6be0-479e-97a6-e8de8228af31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:25.983471 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49c907-6be0-479e-97a6-e8de8228af31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:25.984977 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49c907-6be0-479e-97a6-e8de8228af31 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:26.001837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 262/528] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:26.008168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:26.120696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418d54-6c13-4ed3-960c-c89d1af1c89a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:26.121130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418d54-6c13-4ed3-960c-c89d1af1c89a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:26.121559 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418d54-6c13-4ed3-960c-c89d1af1c89a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:26.123139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 263/529] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:28:26.128079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0f6c3-98b1-4759-91fa-6f44b06d5c28 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:26.128353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0f6c3-98b1-4759-91fa-6f44b06d5c28 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:26.128616 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0f6c3-98b1-4759-91fa-6f44b06d5c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:26.153206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-85b0f6c3-98b1-4759-91fa-6f44b06d5c28 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:26.154391 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-85b0f6c3-98b1-4759-91fa-6f44b06d5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:26.166608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1641b5e-fa88-4411-9b51-8e31128a38cd None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:26.214337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f085d1f-4b0e-4e7c-b4b3-c6ca94dbb645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:26.215720 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f085d1f-4b0e-4e7c-b4b3-c6ca94dbb645 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:26.215995 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f085d1f-4b0e-4e7c-b4b3-c6ca94dbb645 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:26.216261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f085d1f-4b0e-4e7c-b4b3-c6ca94dbb645 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/0a286777ff794c7a973a07881c195de1/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:26.218796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f085d1f-4b0e-4e7c-b4b3-c6ca94dbb645 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=0a286777ff794c7a973a07881c195de1, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:26.220497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f085d1f-4b0e-4e7c-b4b3-c6ca94dbb645 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:26.240560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 267/530] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:26 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/0a286777ff794c7a973a07881c195de1/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:26.243838 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 264/531] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:26.352237 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634cc7-a8f4-4595-ba29-dccdec007cd9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:26.352573 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634cc7-a8f4-4595-ba29-dccdec007cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:26.352817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c634cc7-a8f4-4595-ba29-dccdec007cd9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:26.354404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 268/532] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:26.360731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c134-1d3b-46e5-af13-a96b869eded2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:26.360731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c134-1d3b-46e5-af13-a96b869eded2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:26.360731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c134-1d3b-46e5-af13-a96b869eded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:26.389223 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4877c134-1d3b-46e5-af13-a96b869eded2 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:26.390740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4877c134-1d3b-46e5-af13-a96b869eded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:26.476336 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 265/533] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 18 11:28:26.549507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c634cc7-a8f4-4595-ba29-dccdec007cd9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:26.588324 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:26.670155 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c634cc7-a8f4-4595-ba29-dccdec007cd9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:26.707452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d9dc2-7ed8-479f-b848-81fa50c44673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:26.708112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d9dc2-7ed8-479f-b848-81fa50c44673 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:26.708386 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d9dc2-7ed8-479f-b848-81fa50c44673 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:26.708648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d9dc2-7ed8-479f-b848-81fa50c44673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:26.719771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d9dc2-7ed8-479f-b848-81fa50c44673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c18d9dc2-7ed8-479f-b848-81fa50c44673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:26.725296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:26.726231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:26.727212 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 269/534] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:26.732152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c134-1d3b-46e5-af13-a96b869eded2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:26.764448 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d9dc2-7ed8-479f-b848-81fa50c44673 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:26.803967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:26.907796 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c134-1d3b-46e5-af13-a96b869eded2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:26.919646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:26.938749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d9dc2-7ed8-479f-b848-81fa50c44673 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:26.981031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:26.982014 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:26.982516 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:26.983012 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:26.983890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:26.984418 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:26.985978 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:26.995800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 266/535] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:27.001453 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:27.015920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845716-28c1-43ce-8768-a3d312e93234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:27.016555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845716-28c1-43ce-8768-a3d312e93234 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.016827 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845716-28c1-43ce-8768-a3d312e93234 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.017093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845716-28c1-43ce-8768-a3d312e93234 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.033462 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91845716-28c1-43ce-8768-a3d312e93234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-91845716-28c1-43ce-8768-a3d312e93234 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:27.040024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:27.040978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:27.041821 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:27.047406 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 270/536] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:27.059399 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845716-28c1-43ce-8768-a3d312e93234 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:27.185035 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4973-0364-46f1-936a-f6b80c788363 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:27.186707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:27.256375 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845716-28c1-43ce-8768-a3d312e93234 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:27.267957 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:27.268605 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.268879 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.269142 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.293388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:27.293994 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.294266 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.294532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.295187 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:27.295511 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:27.296533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:27.296869 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:27.298004 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:27.306998 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 271/537] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:27.313274 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:27.335049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:27.336076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:27.336945 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:27.336945 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:27.336945 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:27.337125 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:27.339776 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 267/538] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:27.343881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:27.449903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b237d-42ed-49cb-a844-6b11ddafcec9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:27.490896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e140bf-7bf6-43c2-b6be-adce3580e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:27.491963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e140bf-7bf6-43c2-b6be-adce3580e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.492316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f53e6-944b-41fd-ad66-a5f380ae3d32 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:27.492663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e140bf-7bf6-43c2-b6be-adce3580e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.493150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e140bf-7bf6-43c2-b6be-adce3580e0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.508981 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e140bf-7bf6-43c2-b6be-adce3580e0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:27.511064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e140bf-7bf6-43c2-b6be-adce3580e0c4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-60e140bf-7bf6-43c2-b6be-adce3580e0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:27.528873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:27.529867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:27.530748 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:27.530748 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:27.530748 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:27.537630 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 272/539] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:27.537630 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badc3e9-632b-4e7c-aca0-78cc74a75b9f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.537630 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badc3e9-632b-4e7c-aca0-78cc74a75b9f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.537630 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badc3e9-632b-4e7c-aca0-78cc74a75b9f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.537630 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 273/540] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:27.538010 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c514b-991b-4378-a680-1cc1b4a0d892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:27.538010 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c514b-991b-4378-a680-1cc1b4a0d892 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.538010 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c514b-991b-4378-a680-1cc1b4a0d892 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.538010 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c514b-991b-4378-a680-1cc1b4a0d892 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.539927 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c514b-991b-4378-a680-1cc1b4a0d892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:27.540441 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c514b-991b-4378-a680-1cc1b4a0d892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:27.542109 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c514b-991b-4378-a680-1cc1b4a0d892 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:27.542423 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badc3e9-632b-4e7c-aca0-78cc74a75b9f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:27.555895 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 268/541] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:27.561765 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849e78-9359-475b-bf1c-1d6cd32da147 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.562265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849e78-9359-475b-bf1c-1d6cd32da147 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.562758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849e78-9359-475b-bf1c-1d6cd32da147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.581553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8a849e78-9359-475b-bf1c-1d6cd32da147 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:27.583141 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8a849e78-9359-475b-bf1c-1d6cd32da147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:27.591349 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:27.611338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:27.657110 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badc3e9-632b-4e7c-aca0-78cc74a75b9f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:27.668139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 269/542] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:27.669266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849e78-9359-475b-bf1c-1d6cd32da147 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:27.716886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:27.717549 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.717765 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.718034 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.718667 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:27.718964 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:27.720345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:27.747199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 274/543] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:27.758608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:27.869639 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849e78-9359-475b-bf1c-1d6cd32da147 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:27.938271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:27.938894 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:27.939163 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:27.939454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] PATH_INFO: `/v3/users/swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:27.949524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:27.950953 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:27.963797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:27.964767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 11:28:27.965740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:27.968024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f580137-1526-4249-8e28-c16c01c04b92 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:27.968429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 270/544] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:27.980341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:27.983420 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:27.996956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:28.010802 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:28.011563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.011910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.012272 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.020693 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:28.022672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:28.034250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:28.035268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 275/545] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 18 11:28:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:28.036262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:28.115973 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386e893-2d70-469a-a34d-b69908c3cbde None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:28.154261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1b551-b989-42c1-96e9-5eac4fe59b3b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:28.159652 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:28.160558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.161068 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.162050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.162987 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:28.163863 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:28.166142 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:28.195284 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 271/546] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 18 11:28:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:28.195284 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:28.201380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525d6b2-1404-4822-b5f8-ceab14500973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:28.202159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525d6b2-1404-4822-b5f8-ceab14500973 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.202574 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525d6b2-1404-4822-b5f8-ceab14500973 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.202983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525d6b2-1404-4822-b5f8-ceab14500973 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.203826 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525d6b2-1404-4822-b5f8-ceab14500973 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:28.205452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525d6b2-1404-4822-b5f8-ceab14500973 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:28.231436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 276/547] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:28:28 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:28.232479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525d6b2-1404-4822-b5f8-ceab14500973 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:28.283677 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:28.332307 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:28.368846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506f5a0-f276-4449-9f81-e87eef90ae94 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:28.452199 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:28.452676 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525d6b2-1404-4822-b5f8-ceab14500973 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:28.452789 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.453070 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.453339 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.454125 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:28.454427 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:28.456234 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:28.482666 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 272/548] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Oct 18 11:28:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:28.489438 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:28.513414 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:28.514409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.514915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.515422 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.530749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:28.532800 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:28.549300 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:28.550305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:28.551233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:28.551233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:28.551233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:28.553544 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 277/549] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:28.558836 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:28.612388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bba439-6a47-4e02-ad71-2ebeb46645b9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:28.630138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:28.652800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b118986-e2b5-47c4-8227-9b0c37d35f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:28.653770 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118986-e2b5-47c4-8227-9b0c37d35f66 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.654186 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118986-e2b5-47c4-8227-9b0c37d35f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.654652 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b118986-e2b5-47c4-8227-9b0c37d35f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.665922 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b118986-e2b5-47c4-8227-9b0c37d35f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:28.667672 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b118986-e2b5-47c4-8227-9b0c37d35f66 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5b118986-e2b5-47c4-8227-9b0c37d35f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:28.684874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:28.685996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:28.686903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:28.686903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:28.686903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:28.688850 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 273/550] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:28.690410 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed8cb-bc58-4255-8360-aa9a52bd12f9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.695624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed8cb-bc58-4255-8360-aa9a52bd12f9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.696260 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:28.697143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed8cb-bc58-4255-8360-aa9a52bd12f9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.699239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96398207-3633-4355-8b19-fbf61ec21c91 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:28.699590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 274/551] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:28.701869 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed8cb-bc58-4255-8360-aa9a52bd12f9 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:28.750292 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafaf53-8a27-4904-8a46-894b7b6d50dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:28.750984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafaf53-8a27-4904-8a46-894b7b6d50dc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.751174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafaf53-8a27-4904-8a46-894b7b6d50dc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.751453 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafaf53-8a27-4904-8a46-894b7b6d50dc None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.752084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafaf53-8a27-4904-8a46-894b7b6d50dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:28.752382 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafaf53-8a27-4904-8a46-894b7b6d50dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:28.754330 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afafaf53-8a27-4904-8a46-894b7b6d50dc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:28.772500 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 278/552] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:28.774095 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a602e0-885a-4b5e-8bb8-341d47622e4a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.775739 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a602e0-885a-4b5e-8bb8-341d47622e4a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.776214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a602e0-885a-4b5e-8bb8-341d47622e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.798993 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a2a602e0-885a-4b5e-8bb8-341d47622e4a None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:28.800206 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a2a602e0-885a-4b5e-8bb8-341d47622e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:28.843932 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed8cb-bc58-4255-8360-aa9a52bd12f9 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:28.877449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 279/553] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:28.878282 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a602e0-885a-4b5e-8bb8-341d47622e4a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:28.889765 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e026a-b353-4466-a919-a363219f0ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:28.890912 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e026a-b353-4466-a919-a363219f0ace None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.891378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e026a-b353-4466-a919-a363219f0ace None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.891803 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e026a-b353-4466-a919-a363219f0ace None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.892588 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e026a-b353-4466-a919-a363219f0ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:28.893034 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e026a-b353-4466-a919-a363219f0ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:28.895348 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e026a-b353-4466-a919-a363219f0ace None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:28.909184 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 275/554] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:28.911511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1d1ef-7f83-4ca0-b080-9caaebf120cf None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:28.911943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1d1ef-7f83-4ca0-b080-9caaebf120cf None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:28.912359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1d1ef-7f83-4ca0-b080-9caaebf120cf None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:28.917974 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 276/555] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:28.917974 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1d1ef-7f83-4ca0-b080-9caaebf120cf None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:28.953648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:28.991026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:29.011012 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a602e0-885a-4b5e-8bb8-341d47622e4a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.036707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1d1ef-7f83-4ca0-b080-9caaebf120cf None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.051281 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ac591-6bc6-4ed9-bbf4-796643edc987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.052004 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac591-6bc6-4ed9-bbf4-796643edc987 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.052285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac591-6bc6-4ed9-bbf4-796643edc987 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.052555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ac591-6bc6-4ed9-bbf4-796643edc987 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.060608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ac591-6bc6-4ed9-bbf4-796643edc987 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:29.062332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ac591-6bc6-4ed9-bbf4-796643edc987 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-a27ac591-6bc6-4ed9-bbf4-796643edc987 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:29.075979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:29.076881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 280/556] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:29.078421 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b261-41dd-4865-b58c-f7339a364bfb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.078958 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b261-41dd-4865-b58c-f7339a364bfb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.078958 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78b261-41dd-4865-b58c-f7339a364bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.080573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.081686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.082291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.082753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.090911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:29.092759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:29.098925 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9f78b261-41dd-4865-b58c-f7339a364bfb None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:29.101159 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9f78b261-41dd-4865-b58c-f7339a364bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:29.110414 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:29.111783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:29.112681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:29.112681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:29.112681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:29.112681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:29.112681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:29.112681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:29.112681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:29.112681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:29.115921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 277/557] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:29.116916 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:29.182976 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 281/558] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 18 11:28:29.183775 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78b261-41dd-4865-b58c-f7339a364bfb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:29.215275 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:29.233782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa747c7-8bba-4e48-b524-fdf950139e8d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.270496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.271555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.272038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.272508 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.273691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:29.274439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:29.274947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:29.276641 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:29.290780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 278/559] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:29.292206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:29.303372 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78b261-41dd-4865-b58c-f7339a364bfb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.346271 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.346901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.347178 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.348080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.349216 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:29.349521 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:29.351552 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:29.369226 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 282/560] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:29.371490 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:29.424061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf54e-8176-4ffa-af87-457c2241811b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.466259 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae90ac-1fdf-4209-918e-1295ae0d4d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.466779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae90ac-1fdf-4209-918e-1295ae0d4d89 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.467054 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae90ac-1fdf-4209-918e-1295ae0d4d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.467347 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae90ac-1fdf-4209-918e-1295ae0d4d89 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.467996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae90ac-1fdf-4209-918e-1295ae0d4d89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:29.469356 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae90ac-1fdf-4209-918e-1295ae0d4d89 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:29.482828 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8311b-0951-4618-a92d-a58f12eb7960 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.485244 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 279/561] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:28:29 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:29.486032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae90ac-1fdf-4209-918e-1295ae0d4d89 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:29.496958 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:29.541850 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:29.558146 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce894b1-aca0-42fe-82fe-36a8a1626812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.558944 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce894b1-aca0-42fe-82fe-36a8a1626812 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.559332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce894b1-aca0-42fe-82fe-36a8a1626812 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.559677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce894b1-aca0-42fe-82fe-36a8a1626812 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/ba0cf1bee1f5484992f924d93251a583/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.562202 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce894b1-aca0-42fe-82fe-36a8a1626812 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=ba0cf1bee1f5484992f924d93251a583, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:29.563895 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce894b1-aca0-42fe-82fe-36a8a1626812 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:29.584341 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 283/562] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:29 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/ba0cf1bee1f5484992f924d93251a583/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:29.585448 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce894b1-aca0-42fe-82fe-36a8a1626812 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:29.619608 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae90ac-1fdf-4209-918e-1295ae0d4d89 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.659183 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39725ea4-c4f5-4bd5-822a-20b8d3338ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.661036 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39725ea4-c4f5-4bd5-822a-20b8d3338ac5 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.661506 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39725ea4-c4f5-4bd5-822a-20b8d3338ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.661923 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39725ea4-c4f5-4bd5-822a-20b8d3338ac5 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/c4de9bddab3c4a2e9fe8bb0f61123b67/roles/2954c0a9ecde4a92a2e278db491ab7f9` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.679919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39725ea4-c4f5-4bd5-822a-20b8d3338ac5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=c4de9bddab3c4a2e9fe8bb0f61123b67, role_id=2954c0a9ecde4a92a2e278db491ab7f9)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:29.681655 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39725ea4-c4f5-4bd5-822a-20b8d3338ac5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:29.703382 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 280/563] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:29 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/c4de9bddab3c4a2e9fe8bb0f61123b67/roles/2954c0a9ecde4a92a2e278db491ab7f9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:29.749875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce894b1-aca0-42fe-82fe-36a8a1626812 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.798699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30af17-ef87-40ef-bc91-938a4d2f3b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.799535 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30af17-ef87-40ef-bc91-938a4d2f3b11 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.799722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30af17-ef87-40ef-bc91-938a4d2f3b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.800093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30af17-ef87-40ef-bc91-938a4d2f3b11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.814126 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30af17-ef87-40ef-bc91-938a4d2f3b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7a30af17-ef87-40ef-bc91-938a4d2f3b11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:29.820581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:29.821596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:29.822424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 284/564] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:29.831362 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39725ea4-c4f5-4bd5-822a-20b8d3338ac5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:29.900903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:29.951312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39725ea4-c4f5-4bd5-822a-20b8d3338ac5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:29.987877 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:29.989041 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:29.989380 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:29.989585 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:29.990242 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:29.990601 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:29.992008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:30.004960 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 281/565] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:30.007004 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30af17-ef87-40ef-bc91-938a4d2f3b11 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:30.062242 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:30.117491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30af17-ef87-40ef-bc91-938a4d2f3b11 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:30.153934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:30.154571 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:30.154848 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:30.155151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:30.166329 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:30.167817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:30.183812 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:30.184774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:30.185651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:30.185651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:30.185651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:30.189571 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 285/566] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:30.190930 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:30.330166 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd0d7-91ef-4a12-a43d-fc243dc3af86 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:30.357689 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:30.392545 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:30.393167 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:30.393446 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:30.393717 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:30.395211 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:30.395544 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:30.396924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:30.416602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 282/567] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:30.426141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:30.557510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f807-8f51-4a6b-b974-ce1d9676858c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:30.559066 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:30.594081 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821f832-91a2-4bd9-b61f-3ac97d087738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:30.594628 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f832-91a2-4bd9-b61f-3ac97d087738 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:30.594905 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f832-91a2-4bd9-b61f-3ac97d087738 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:30.595174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f832-91a2-4bd9-b61f-3ac97d087738 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:30.603443 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821f832-91a2-4bd9-b61f-3ac97d087738 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:30.604896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821f832-91a2-4bd9-b61f-3ac97d087738 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8821f832-91a2-4bd9-b61f-3ac97d087738 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:30.617305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:30.619612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:28:30.621885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:30.623152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 286/568] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 18 11:28:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:30.628357 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:30.796693 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87531bee-65a5-47ca-ae62-455d8fbfe523 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:30.798979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efccc42-0743-4257-9566-096bf9fd3039 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:30.799540 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efccc42-0743-4257-9566-096bf9fd3039 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:30.799540 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efccc42-0743-4257-9566-096bf9fd3039 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:30.804389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 287/569] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:30.808460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314225f0-b0e1-4f26-9c4c-19a4017346b8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:30.808743 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314225f0-b0e1-4f26-9c4c-19a4017346b8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:30.809465 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314225f0-b0e1-4f26-9c4c-19a4017346b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:30.850484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-314225f0-b0e1-4f26-9c4c-19a4017346b8 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:30.851652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-314225f0-b0e1-4f26-9c4c-19a4017346b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:30.867746 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:30.868366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:30.868642 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:30.868912 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:30.869654 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:30.869956 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:30.871457 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:30.911992 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 283/570] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 18 11:28:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:30.917039 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:30.985860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:31.018054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 288/571] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:31.063615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1ac1f-9338-42f2-bd34-f8b44b23e87b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:31.104874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c7f6f-5481-4b4b-b9e3-a175ed5fdcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:31.105546 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c7f6f-5481-4b4b-b9e3-a175ed5fdcef None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:31.105826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c7f6f-5481-4b4b-b9e3-a175ed5fdcef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:31.106109 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c7f6f-5481-4b4b-b9e3-a175ed5fdcef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:31.200486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c7f6f-5481-4b4b-b9e3-a175ed5fdcef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:31.202016 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c7f6f-5481-4b4b-b9e3-a175ed5fdcef None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:31.252038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:31.336329 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314225f0-b0e1-4f26-9c4c-19a4017346b8 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:31.339279 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 284/572] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:28:31.344521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c7f6f-5481-4b4b-b9e3-a175ed5fdcef None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:31.458157 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c7f6f-5481-4b4b-b9e3-a175ed5fdcef None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:31.513318 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:31.524075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:31.524713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:31.524992 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:31.525264 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:31.530589 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314225f0-b0e1-4f26-9c4c-19a4017346b8 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:31.531107 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:31.546644 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:31.548138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:31.574005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:31.575077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:31.575997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:31.575997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:31.575997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:31.580814 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 285/573] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:31.585545 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:31.604270 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:31.604983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:31.605264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:31.605533 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:31.606115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:31.608232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:31.622405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:31.623510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:31.624345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:31.631354 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 289/574] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 18 11:28:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:31.635041 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:31.790534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc4b97-f55e-484c-ac54-3fb95ac00256 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:31.797058 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7848415-6758-4276-877b-0e0f84119a9c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:31.865605 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:31.866214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:31.866492 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:31.866767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:31.868608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:31.869213 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:31.869488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:31.869753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:31.870375 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:31.870669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:31.872061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:31.873322 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:31.873635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:31.875008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:31.884215 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 290/575] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 18 11:28:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:31.892473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 286/576] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:31.893710 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:31.898075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:31.937033 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:31.992339 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:32.062699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b5406-0f8d-4b12-a163-4760ccf12981 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:32.094872 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac09f0-4e32-4477-8e51-a97a18de2864 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:32.133391 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:32.134025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.134301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.134571 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.141951 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:32.143441 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:32.157124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:32.158100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:32.159071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:32.159071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:32.159071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:32.159071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:32.159071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:32.159071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:32.159071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:32.159071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:32.163302 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 287/577] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:32.164562 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:32.184750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273496c7-7378-45ef-afe5-2fccc8d3c8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:32.185379 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273496c7-7378-45ef-afe5-2fccc8d3c8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.185661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273496c7-7378-45ef-afe5-2fccc8d3c8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.185930 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273496c7-7378-45ef-afe5-2fccc8d3c8c7 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.186569 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273496c7-7378-45ef-afe5-2fccc8d3c8c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:32.186868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273496c7-7378-45ef-afe5-2fccc8d3c8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:32.188337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273496c7-7378-45ef-afe5-2fccc8d3c8c7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:32.203880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 291/578] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 18 11:28:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:32.203880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4738950-ebf5-4639-9fee-074c24069c48 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.203880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4738950-ebf5-4639-9fee-074c24069c48 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.203880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4738950-ebf5-4639-9fee-074c24069c48 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.203880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 292/579] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:32.210751 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b89f6-cc73-4d1f-8e8e-60c97b9b9fae None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.211230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b89f6-cc73-4d1f-8e8e-60c97b9b9fae None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.211559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b89f6-cc73-4d1f-8e8e-60c97b9b9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.234214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e29b89f6-cc73-4d1f-8e8e-60c97b9b9fae None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:32.235590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e29b89f6-cc73-4d1f-8e8e-60c97b9b9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:32.298676 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a59e-d3b0-4bc8-90c4-4477267eccfd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:32.310724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:32.321575 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 293/580] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:32.322795 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b89f6-cc73-4d1f-8e8e-60c97b9b9fae None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:32.340571 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:32.343744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d475bc-3aee-442b-88d1-44fdd8d66c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:32.344524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d475bc-3aee-442b-88d1-44fdd8d66c2d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.346972 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d475bc-3aee-442b-88d1-44fdd8d66c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.346972 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d475bc-3aee-442b-88d1-44fdd8d66c2d None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.346972 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d475bc-3aee-442b-88d1-44fdd8d66c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:32.346972 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d475bc-3aee-442b-88d1-44fdd8d66c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:32.349155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d475bc-3aee-442b-88d1-44fdd8d66c2d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:32.368350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 288/581] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:32.369992 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51671414-ed1e-43d7-baaa-42a6806aea6b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.370508 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51671414-ed1e-43d7-baaa-42a6806aea6b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.370970 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51671414-ed1e-43d7-baaa-42a6806aea6b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.373031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 289/582] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:32.373996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51671414-ed1e-43d7-baaa-42a6806aea6b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:32.447294 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b89f6-cc73-4d1f-8e8e-60c97b9b9fae None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:32.489043 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35199a0-a0d8-4533-8b70-49d6ac823074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:32.489998 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35199a0-a0d8-4533-8b70-49d6ac823074 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.490499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35199a0-a0d8-4533-8b70-49d6ac823074 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.490986 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35199a0-a0d8-4533-8b70-49d6ac823074 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.491926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35199a0-a0d8-4533-8b70-49d6ac823074 None admin] RBAC: Adding query filter params (interface=public, service_id=106b705dbef9474cb77e7de0959e6ac9, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:32.492455 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35199a0-a0d8-4533-8b70-49d6ac823074 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:32.493857 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51671414-ed1e-43d7-baaa-42a6806aea6b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:32.494263 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35199a0-a0d8-4533-8b70-49d6ac823074 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:32.507504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 294/583] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 18 11:28:32 2022] GET /identity/v3/endpoints?service_id=106b705dbef9474cb77e7de0959e6ac9&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:32.509362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b601f2-2ead-4d76-9488-69ee69576cb9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.509866 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b601f2-2ead-4d76-9488-69ee69576cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.510331 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b601f2-2ead-4d76-9488-69ee69576cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.531826 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-61b601f2-2ead-4d76-9488-69ee69576cb9 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:32.533431 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-61b601f2-2ead-4d76-9488-69ee69576cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:32.541858 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:32.542573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.542919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.543290 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.544089 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=0a286777ff794c7a973a07881c195de1) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:32.544469 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:32.546797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:32.563322 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 290/584] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:32 2022] GET /identity/v3/role_assignments?user.id=0a286777ff794c7a973a07881c195de1&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=78ddf427bf274205867c7492aec1f590 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:32.563322 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:32.622014 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:32.654525 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 295/585] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:32.655422 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b601f2-2ead-4d76-9488-69ee69576cb9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:32.668532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:32.717501 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91adc2e-79ee-4efe-98d4-b75e5549026a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:32.762885 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9eada-4cdc-4770-8d71-04d648d77eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:32.764683 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9eada-4cdc-4770-8d71-04d648d77eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.764683 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9eada-4cdc-4770-8d71-04d648d77eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.764683 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9eada-4cdc-4770-8d71-04d648d77eb3 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.765069 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9eada-4cdc-4770-8d71-04d648d77eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:32.766871 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9eada-4cdc-4770-8d71-04d648d77eb3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:32.773419 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 291/586] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:28:32 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:32.774617 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e303-1254-4889-8dec-0334105dbc56 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.774894 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e303-1254-4889-8dec-0334105dbc56 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.775167 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8e303-1254-4889-8dec-0334105dbc56 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.781765 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 292/587] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:32.781956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b601f2-2ead-4d76-9488-69ee69576cb9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:32.783086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262cf0-3600-4c4f-a740-7ac0b400105c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.783509 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262cf0-3600-4c4f-a740-7ac0b400105c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.783702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262cf0-3600-4c4f-a740-7ac0b400105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.805180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ea262cf0-3600-4c4f-a740-7ac0b400105c None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:32.806500 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ea262cf0-3600-4c4f-a740-7ac0b400105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:32.844547 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94d68e-0382-46a3-81bc-791ec2e53588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:32.845529 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94d68e-0382-46a3-81bc-791ec2e53588 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:32.845967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94d68e-0382-46a3-81bc-791ec2e53588 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:32.846394 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94d68e-0382-46a3-81bc-791ec2e53588 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:32.859374 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94d68e-0382-46a3-81bc-791ec2e53588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6c94d68e-0382-46a3-81bc-791ec2e53588 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:32.866109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:32.867188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:32.868135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 296/588] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:32.874180 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94d68e-0382-46a3-81bc-791ec2e53588 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:32.901488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 293/589] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:32.952073 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:32.964712 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea262cf0-3600-4c4f-a740-7ac0b400105c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.003755 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:33.007986 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94d68e-0382-46a3-81bc-791ec2e53588 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.065532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.066964 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.067240 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.068237 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.068912 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:33.069216 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.070586 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:33.083017 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 297/590] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:33.088759 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.104744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea262cf0-3600-4c4f-a740-7ac0b400105c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.160885 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbc592-8a61-4a18-8bea-55f9db109d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.161430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc592-8a61-4a18-8bea-55f9db109d94 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.163225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc592-8a61-4a18-8bea-55f9db109d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.163518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc592-8a61-4a18-8bea-55f9db109d94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.187204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbc592-8a61-4a18-8bea-55f9db109d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-3abbc592-8a61-4a18-8bea-55f9db109d94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:33.195518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:33.196474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:33.197305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 294/591] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:28:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:33.213041 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbc592-8a61-4a18-8bea-55f9db109d94 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.257112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dac1b6-2b83-4f94-ad60-269f06835459 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.291691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:33.298550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.299512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.300044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.301072 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.314106 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.316021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:33.333010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:33.333996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:33.334893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:33.334893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:33.334893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:33.335735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:33.337857 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 298/592] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:33.338841 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.355216 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbc592-8a61-4a18-8bea-55f9db109d94 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.402922 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.403573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.403997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.404274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.405251 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:33.405816 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.407185 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:33.419424 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 295/593] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:33.420354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.453124 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2e674-071c-48cb-83ef-be0ee1f8e9f2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.497834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.498628 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.499063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.499449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] PATH_INFO: `/v3/services/network` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.500261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.502640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:33.513753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:33.514860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:33.515756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 299/594] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:33.516584 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.540338 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427aa142-69c1-40ec-8bf2-4cf6e2200419 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.573257 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:33.576876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.577538 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.577813 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.578082 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.578824 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:33.579060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.580468 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:33.598996 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 296/595] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:33.600113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.614285 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:33.643110 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c9196-df60-40db-a2ad-7e3cbf867d2c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.684235 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.684775 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.685041 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.685308 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.696833 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.698331 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:33.714458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:33.715610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:33.716507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:33.716507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:33.716507 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:33.719385 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 300/596] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:33.720253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.742254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfc28-93dd-4655-9f7b-4751c53eaecc None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.795718 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.796329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.796602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.796867 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.797490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] RBAC: Adding query filter params (name=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:33.798818 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.800224 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:33.810189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 297/597] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:33.810189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.841230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:33.846625 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01367f-8ca7-4ea5-bdff-e2799e501608 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.888677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.889445 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.889823 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.890209 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.900935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.902665 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:33.908548 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:33.920771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:33.921784 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:33.923173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 301/598] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:33.923900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:33.952491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73746-1920-46d6-9b7a-d07fc952b018 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:33.989821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:33.990471 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:33.990745 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:33.991011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:33.991739 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:33.992033 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:33.993447 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.009997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 298/599] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:34.009997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:34.061143 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2169-01fe-4269-b3e2-12b6bfa4d5f1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.102976 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:34.103958 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:34.104482 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:34.104887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:34.105657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] RBAC: Adding query filter params (type=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:34.106326 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:34.108143 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.116375 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 302/600] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:34.117469 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:34.122901 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9b8e0-5b8f-441a-be46-d9834d7fad2f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.146691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:34.155637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:34.162748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:34.163123 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:34.163551 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:34.163894 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:34.164727 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:34.165096 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:34.166648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.185543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 299/601] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:34.186568 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:34.238321 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453445d2-625d-4e7f-bae3-bd7394691c65 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.281979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:34.282715 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:34.283063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:34.283438 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:34.294499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:34.296710 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.299620 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528862f-1b4d-45d3-8b08-cd6f1c7d2701 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:34.310679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:34.311691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 11:28:34.312661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:34.315328 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 303/602] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:34.316906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:34.345748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:34.346724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:34.347779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:34.348338 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:34.349247 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] RBAC: Adding query filter params (interface=public, service_id=bdec29e8f59745eab2e352b1ae237b8b, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:34.349753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:34.351352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.359239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 300/603] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/endpoints?service_id=bdec29e8f59745eab2e352b1ae237b8b&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:34.360277 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:34.420867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:34.440353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:34.448263 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a121f-77e7-492c-a41e-7881186502d6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.488804 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908c435-2629-4837-9ed3-ceee91e1c7e8 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.489668 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31110dc0-64e1-403b-bbc8-139560f170d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:34.490271 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31110dc0-64e1-403b-bbc8-139560f170d7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:34.490546 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31110dc0-64e1-403b-bbc8-139560f170d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:34.490817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31110dc0-64e1-403b-bbc8-139560f170d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:34.526074 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:34.527095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:34.527599 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:34.528067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:34.528980 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:34.529543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:34.531177 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.550289 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 301/604] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:34.552144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:34.580557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31110dc0-64e1-403b-bbc8-139560f170d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:34.582041 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31110dc0-64e1-403b-bbc8-139560f170d7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.680312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5cb0b-05d5-4b9a-9f9f-56823f675d02 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.681674 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:34.701790 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:34.712712 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 304/605] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:28:34.713627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31110dc0-64e1-403b-bbc8-139560f170d7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:34.734291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f95e1a-135b-45f0-84b7-c8d082527dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:34.735849 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95e1a-135b-45f0-84b7-c8d082527dfa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:34.736348 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95e1a-135b-45f0-84b7-c8d082527dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:34.737100 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f95e1a-135b-45f0-84b7-c8d082527dfa None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:34.738459 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f95e1a-135b-45f0-84b7-c8d082527dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:34.741127 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f95e1a-135b-45f0-84b7-c8d082527dfa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.749166 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 302/606] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:34.750239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f95e1a-135b-45f0-84b7-c8d082527dfa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:34.877011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f95e1a-135b-45f0-84b7-c8d082527dfa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.925028 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:34.926436 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:34.926817 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:34.927093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:34.929662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31110dc0-64e1-403b-bbc8-139560f170d7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:34.940758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:34.942785 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:34.960274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:34.961276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:34.962208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:34.962208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:34.962208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:34.962381 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 303/607] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:34.970139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:35.007583 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a4275-ab32-48d6-a346-ec0a12b2c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:35.008702 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4275-ab32-48d6-a346-ec0a12b2c4fd None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.008990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4275-ab32-48d6-a346-ec0a12b2c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.009265 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4275-ab32-48d6-a346-ec0a12b2c4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.043749 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:35.072806 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:35.094527 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a4275-ab32-48d6-a346-ec0a12b2c4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:35.096031 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a4275-ab32-48d6-a346-ec0a12b2c4fd None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:35.153265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17754df4-e09c-4977-9a9b-cabaee1a3a9f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:35.203533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0933507-7bd6-444e-ba58-1924d452fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:35.204145 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933507-7bd6-444e-ba58-1924d452fb5d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.204422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933507-7bd6-444e-ba58-1924d452fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.204700 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0933507-7bd6-444e-ba58-1924d452fb5d None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.205341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0933507-7bd6-444e-ba58-1924d452fb5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:35.205641 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0933507-7bd6-444e-ba58-1924d452fb5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:35.207810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0933507-7bd6-444e-ba58-1924d452fb5d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:35.219168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 305/608] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:28:35.220942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066da6-ae8d-436e-9a7d-dda5f9dfb133 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.221429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066da6-ae8d-436e-9a7d-dda5f9dfb133 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.221899 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0066da6-ae8d-436e-9a7d-dda5f9dfb133 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.224241 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 306/610] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:35.225451 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7341f2-c8eb-44dd-aa0f-fe14972aad0b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.225731 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7341f2-c8eb-44dd-aa0f-fe14972aad0b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.226001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7341f2-c8eb-44dd-aa0f-fe14972aad0b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.227319 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 307/611] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:35.227503 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 304/611] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:35.227985 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7341f2-c8eb-44dd-aa0f-fe14972aad0b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:35.229728 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3abd65-8b7c-4f7e-b06e-41f89da49dae None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.230016 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3abd65-8b7c-4f7e-b06e-41f89da49dae None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.230294 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3abd65-8b7c-4f7e-b06e-41f89da49dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.252270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4b3abd65-8b7c-4f7e-b06e-41f89da49dae None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:35.253483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4b3abd65-8b7c-4f7e-b06e-41f89da49dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:35.314910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:35.328357 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 305/612] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:35.329938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c150c-918d-41dc-b640-eb5d2922e615 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.330219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c150c-918d-41dc-b640-eb5d2922e615 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.330543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c150c-918d-41dc-b640-eb5d2922e615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.344622 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7341f2-c8eb-44dd-aa0f-fe14972aad0b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:35.350770 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-384c150c-918d-41dc-b640-eb5d2922e615 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:35.351968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-384c150c-918d-41dc-b640-eb5d2922e615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:35.370665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:35.390380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:35.391010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.391482 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.392241 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.406122 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:35.407752 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:35.426960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:35.428007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:35.428904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:35.428904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:35.428904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:35.428904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 308/613] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:35.428904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:35.433256 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 306/614] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:35.434520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c150c-918d-41dc-b640-eb5d2922e615 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:35.566897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c150c-918d-41dc-b640-eb5d2922e615 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:35.570073 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ca2e5-1416-418d-9a99-bf8f0879eb23 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:35.614133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:35.614852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.615130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.615463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.616101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:35.616501 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:35.618095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:35.619353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:35.619983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.620256 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.620524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.622524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:35.628260 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:35.630356 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:35.634377 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 307/615] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:35.639915 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:35.651876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:35.657301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:35.658219 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:35.659105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 309/616] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:35.663893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:35.755630 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acfa5f-c754-4831-b828-4120d3cdc007 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:35.791477 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f898ad8-f7ca-41bc-9a73-1ad01debc008 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:35.793242 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:35.793834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.794111 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.794379 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.801982 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:35.803565 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:35.815144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:35.816819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:35.820103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 308/617] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:35.825268 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:35.837830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:35.837830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.837830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.837830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.838301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:35.839226 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:35.850425 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:35.851729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:35.852645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 310/618] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 18 11:28:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:35.853485 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:35.903543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:35.920677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:35.938319 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505d45d-6579-49e0-970b-43cda6434b9e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:35.965522 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0f641-c1dc-40a1-9936-6788c84ba72b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:35.974246 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:35.974856 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:35.975129 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:35.975430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:35.976113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:35.976413 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:35.977831 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:35.995413 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 309/619] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:35.996272 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:36.001722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.002351 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.002631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.002903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.003532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.005232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:36.014022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:36.014989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:36.015880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 311/620] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Oct 18 11:28:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:36.016672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:36.104020 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cf548-01b1-4f7f-9bd9-4ceb1f356bd5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:36.126699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567dcf0-f395-44ee-8a02-4c96462c50c3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:36.133332 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:36.142973 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.143605 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.144023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.144342 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.145136 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:36.145438 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.146857 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.150323 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:36.163297 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 310/621] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:36.163297 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:36.168179 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.168792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.169069 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.169333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.169960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:36.170257 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.171771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.177292 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 312/622] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:36.178064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:36.277025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f14c68-5598-4298-b9fa-ed07e5c7531f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:36.290485 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25df0e-6530-4b06-97fa-d5aa10878a08 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:36.313959 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.314557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.314835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.315117 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.315893 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=ba0cf1bee1f5484992f924d93251a583) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:36.316313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.317755 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.335290 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 311/623] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:36 2022] GET /identity/v3/role_assignments?user.id=ba0cf1bee1f5484992f924d93251a583&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=78ddf427bf274205867c7492aec1f590 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:36.335290 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:36.337844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.338551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.338916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.339337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.340055 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:36.340451 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.341921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.352926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 313/624] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 18 11:28:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:36.354096 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:36.404292 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:36.419839 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:36.467890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e74e7b-7580-4cf0-9499-64cdbe3ad48c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:36.498708 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd4752-2e9e-4013-9ef8-9a9646cf0e51 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:36.507446 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.509322 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.509836 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.510280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.511696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] RBAC: Adding query filter params (role.id=2954c0a9ecde4a92a2e278db491ab7f9, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=c4de9bddab3c4a2e9fe8bb0f61123b67) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:36.512204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.514617 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.523899 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 312/625] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:36 2022] GET /identity/v3/role_assignments?user.id=c4de9bddab3c4a2e9fe8bb0f61123b67&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=2954c0a9ecde4a92a2e278db491ab7f9 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:36.525039 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:36.554307 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.556079 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.556530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.556956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.558067 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:36.558551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.560509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.568440 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 314/626] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:36.665127 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a88dc4-7fb4-4209-9c38-51b46fa046b0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:36.684997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:36.705891 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e822ac8-7e74-4ec9-8348-ae62a1a2a222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.706726 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822ac8-7e74-4ec9-8348-ae62a1a2a222 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.707065 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822ac8-7e74-4ec9-8348-ae62a1a2a222 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.707276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822ac8-7e74-4ec9-8348-ae62a1a2a222 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.707944 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822ac8-7e74-4ec9-8348-ae62a1a2a222 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:36.708247 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822ac8-7e74-4ec9-8348-ae62a1a2a222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.709746 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e822ac8-7e74-4ec9-8348-ae62a1a2a222 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.715865 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 313/627] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Oct 18 11:28:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:36.721763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:36.857512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03624a-0159-4dd3-a46f-6362ed13f709 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:36.873290 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:36.900961 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136548e8-eb52-4ba2-8823-4962055f7547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:36.901969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136548e8-eb52-4ba2-8823-4962055f7547 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:36.902447 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136548e8-eb52-4ba2-8823-4962055f7547 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:36.902933 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136548e8-eb52-4ba2-8823-4962055f7547 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:36.903924 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136548e8-eb52-4ba2-8823-4962055f7547 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:36.905475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136548e8-eb52-4ba2-8823-4962055f7547 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:36.934860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 315/628] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:28:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:37.197559 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579821a-9209-4b19-a57a-4f55e8826d4d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:37.198048 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579821a-9209-4b19-a57a-4f55e8826d4d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:37.198048 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579821a-9209-4b19-a57a-4f55e8826d4d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:37.199646 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 314/629] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:37.205050 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465f58f-6d95-4b03-a11f-3f8956e920eb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:37.205534 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465f58f-6d95-4b03-a11f-3f8956e920eb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:37.205615 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465f58f-6d95-4b03-a11f-3f8956e920eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:37.231569 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-2465f58f-6d95-4b03-a11f-3f8956e920eb None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:37.233135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2465f58f-6d95-4b03-a11f-3f8956e920eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:37.317708 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 316/630] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:37.599695 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579821a-9209-4b19-a57a-4f55e8826d4d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:37.736685 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579821a-9209-4b19-a57a-4f55e8826d4d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:37.780426 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:37.781440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:37.781932 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:37.782432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] PATH_INFO: `/v3/services/network` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:37.783225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:37.784862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:37.797714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:37.798735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 18 11:28:37.799637 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:37.802910 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 315/631] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:37 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:37.809009 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465f58f-6d95-4b03-a11f-3f8956e920eb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:37.910900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:37.923565 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465f58f-6d95-4b03-a11f-3f8956e920eb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:37.975231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:37.975870 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:37.976146 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:37.976420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:37.977050 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] RBAC: Adding query filter params (name=network) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:37.977354 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:37.978717 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:37.983798 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 317/632] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:37.990439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:38.051048 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:38.127392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a106e0-0528-4d52-9fe6-1f4aac37cc96 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:38.168901 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2191da4-da1c-4e03-96d6-6e771f3ccb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:38.169424 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2191da4-da1c-4e03-96d6-6e771f3ccb83 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:38.169705 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2191da4-da1c-4e03-96d6-6e771f3ccb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:38.169981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2191da4-da1c-4e03-96d6-6e771f3ccb83 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:38.170609 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2191da4-da1c-4e03-96d6-6e771f3ccb83 None admin] RBAC: Adding query filter params (type=network) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:38.170912 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2191da4-da1c-4e03-96d6-6e771f3ccb83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:38.172308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2191da4-da1c-4e03-96d6-6e771f3ccb83 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:38.179915 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 316/633] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:38.185652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:38.317855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d0c95-1971-4d51-9005-d2e189579c3c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:38.351855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258d487-8ce1-4f52-8b22-5bf0a31dece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:38.352456 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d487-8ce1-4f52-8b22-5bf0a31dece2 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:38.352734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d487-8ce1-4f52-8b22-5bf0a31dece2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:38.353003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258d487-8ce1-4f52-8b22-5bf0a31dece2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:38.353656 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d487-8ce1-4f52-8b22-5bf0a31dece2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:38.355006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258d487-8ce1-4f52-8b22-5bf0a31dece2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:38.383080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 318/634] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:28:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:39.123199 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8acc-451d-49db-a73c-7dd7b247f1c9 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.123798 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8acc-451d-49db-a73c-7dd7b247f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.123798 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8acc-451d-49db-a73c-7dd7b247f1c9 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.125518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 317/635] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:39.132722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbee92-0473-48c7-b8a4-e7c5d2241e7b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.133198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbee92-0473-48c7-b8a4-e7c5d2241e7b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.133471 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbee92-0473-48c7-b8a4-e7c5d2241e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.154323 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-3fdbee92-0473-48c7-b8a4-e7c5d2241e7b None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:39.155561 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3fdbee92-0473-48c7-b8a4-e7c5d2241e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:39.168010 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:39.251491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 319/636] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:39.264792 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908539fe-18a7-413b-ba5a-779f8c890941 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.265077 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908539fe-18a7-413b-ba5a-779f8c890941 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.265358 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908539fe-18a7-413b-ba5a-779f8c890941 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.266936 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 318/637] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:39.272139 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7a25-a5f3-4bb8-86e8-f273a801cb68 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.272424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7a25-a5f3-4bb8-86e8-f273a801cb68 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.272695 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a7a25-a5f3-4bb8-86e8-f273a801cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.291326 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-320a7a25-a5f3-4bb8-86e8-f273a801cb68 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:39.292485 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-320a7a25-a5f3-4bb8-86e8-f273a801cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:39.366793 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 320/638] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:39.506330 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de66ea2-c2b4-4f0d-83b1-6c0a8de0e3de None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.506622 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de66ea2-c2b4-4f0d-83b1-6c0a8de0e3de None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.507183 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de66ea2-c2b4-4f0d-83b1-6c0a8de0e3de None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.509069 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 319/639] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:39.514429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a0f6-8244-478f-8fde-0cd0db1ae8eb None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.514948 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a0f6-8244-478f-8fde-0cd0db1ae8eb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.515476 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a0f6-8244-478f-8fde-0cd0db1ae8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.533809 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b417a0f6-8244-478f-8fde-0cd0db1ae8eb None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:39.535322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b417a0f6-8244-478f-8fde-0cd0db1ae8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:39.552748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de66ea2-c2b4-4f0d-83b1-6c0a8de0e3de None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:39.622844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 321/640] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:39.654187 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417a0f6-8244-478f-8fde-0cd0db1ae8eb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:39.657035 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:39.691666 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de66ea2-c2b4-4f0d-83b1-6c0a8de0e3de None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:39.702179 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:39.730187 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edb08e-cd67-4111-96af-acfd0892a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:39.730861 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edb08e-cd67-4111-96af-acfd0892a432 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.731138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edb08e-cd67-4111-96af-acfd0892a432 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.731449 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edb08e-cd67-4111-96af-acfd0892a432 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.732048 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edb08e-cd67-4111-96af-acfd0892a432 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:39.733403 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edb08e-cd67-4111-96af-acfd0892a432 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-29edb08e-cd67-4111-96af-acfd0892a432 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:39.743032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:39.744085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:39.744919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 320/641] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:39.745721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eee5b-9f15-4f74-9a60-333c538e3628 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.745721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eee5b-9f15-4f74-9a60-333c538e3628 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.745842 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eee5b-9f15-4f74-9a60-333c538e3628 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.747217 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 321/642] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:39.753075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b887e5-7a7d-49bb-9233-c876825373d4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.753313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b887e5-7a7d-49bb-9233-c876825373d4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.753567 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b887e5-7a7d-49bb-9233-c876825373d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.773153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-51b887e5-7a7d-49bb-9233-c876825373d4 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:39.774518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-51b887e5-7a7d-49bb-9233-c876825373d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:39.778509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417a0f6-8244-478f-8fde-0cd0db1ae8eb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:39.816592 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f261d-a4c3-4c71-a982-ec7dab1508b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:39.817198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f261d-a4c3-4c71-a982-ec7dab1508b6 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:39.817477 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f261d-a4c3-4c71-a982-ec7dab1508b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:39.817749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f261d-a4c3-4c71-a982-ec7dab1508b6 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:39.818400 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f261d-a4c3-4c71-a982-ec7dab1508b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:39.819788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f261d-a4c3-4c71-a982-ec7dab1508b6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:39.837648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 322/643] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:28:39 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:28:39.837648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f261d-a4c3-4c71-a982-ec7dab1508b6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:39.890766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 322/644] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:39 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:39.895000 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b887e5-7a7d-49bb-9233-c876825373d4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:39.924172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:39.986650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f261d-a4c3-4c71-a982-ec7dab1508b6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.019297 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:40.024375 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b887e5-7a7d-49bb-9233-c876825373d4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.038268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.038878 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.039153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.039458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.040243 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:40.040555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.042313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.047025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 323/645] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:40.053100 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.066930 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3c74a-995d-404f-a3a1-caec7c9c63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.067592 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c74a-995d-404f-a3a1-caec7c9c63d5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.067867 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c74a-995d-404f-a3a1-caec7c9c63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.068143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3c74a-995d-404f-a3a1-caec7c9c63d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.084428 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3c74a-995d-404f-a3a1-caec7c9c63d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-66d3c74a-995d-404f-a3a1-caec7c9c63d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:40.090665 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:40.091662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:40.092517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 323/646] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 18 11:28:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:40.099520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3c74a-995d-404f-a3a1-caec7c9c63d5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.182537 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84fabf-d84b-4871-9fb9-4d238398eb71 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.207198 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3c74a-995d-404f-a3a1-caec7c9c63d5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.211836 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:40.223026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.223829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.224117 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.224389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.225338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:40.225645 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.227014 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.243298 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 324/647] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:40.243298 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.247113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.247851 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.248189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.248523 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.249271 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:40.249636 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.251143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.266114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 324/648] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:40.267187 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.292800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:40.385301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38dcc-06a5-4506-8229-0ebf4a8cd2db None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.391311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c7b58-776c-4a3f-842c-cce5db61eb3e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.430089 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.432442 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.432442 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.432442 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.432703 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.434892 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.437050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.437690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.437969 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.438242 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:40.445113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:40.446123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:40.446979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 325/649] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:40.452626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.457445 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.459105 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:40.477670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:40.478702 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:40.480450 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:40.480450 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:40.480450 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:40.480450 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 325/650] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:40.484367 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.516244 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:40.573218 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2d78-3e43-432d-9531-baf8fd69e8f2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.575278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:40.607926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52c96-79a9-4d58-ab6c-ff77a1313cb3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.623908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.624528 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.624809 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.625347 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.626393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:40.626705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.628112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.636271 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 326/651] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:40.645726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.650748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.651682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.652168 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.652663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.653524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:40.654026 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.655615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.668891 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 326/652] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:40.673943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.770454 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfb241-bb29-4b94-b9b3-fd43042f7fe0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.790344 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac939573-9423-4bde-85ae-f53296bfcbfa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:40.791199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:40.817097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.817719 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.818570 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.818857 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.819523 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:40.819828 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.821215 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.834546 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 327/653] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:40.834767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:40.844839 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:40.845552 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:40.845828 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:40.846093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:40.855622 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:40.857292 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:40.870638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:40.871713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:40.872686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 327/654] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:40.877967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:40.994253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3bced-39e3-4d24-a743-be2a2f62f832 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:41.030311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:41.030911 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:41.031181 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:41.031475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:41.032194 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:41.032492 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:41.033900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:41.053694 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 328/655] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Oct 18 11:28:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:41.059127 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:41.163542 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6b303-c74a-440d-8e36-ef8bf4f22d62 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:41.200165 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:41.200852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:41.201126 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:41.201391 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:41.212615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:41.214121 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:41.229266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:41.231525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:41.233766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:41.233766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:41.233766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:41.233766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 328/656] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:41.239275 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:41.280185 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:41.343154 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13e680-a03e-473e-b9a0-6709731b9348 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:41.378590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:41.379463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:41.379736 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:41.380000 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:41.380626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:41.380917 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:41.382334 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:41.394160 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 329/657] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:41.399682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:41.448178 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:41.508836 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0e755-370e-4ddd-8636-ed747f8bd569 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:41.547127 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:41.547794 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:41.548073 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:41.548347 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:41.556858 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:41.558311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:41.570913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:41.571928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:41.572843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 329/658] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:41.579273 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:41.681496 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:41.685926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae2623-7f74-42d8-a067-7be42c885ae3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:41.721744 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf1acf-214e-4a2b-8a0c-1698aac9bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:41.722973 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1acf-214e-4a2b-8a0c-1698aac9bac1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:41.723276 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1acf-214e-4a2b-8a0c-1698aac9bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:41.723554 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1acf-214e-4a2b-8a0c-1698aac9bac1 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:41.724247 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf1acf-214e-4a2b-8a0c-1698aac9bac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:41.724550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf1acf-214e-4a2b-8a0c-1698aac9bac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:41.725967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf1acf-214e-4a2b-8a0c-1698aac9bac1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:41.739090 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 330/659] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:41.744613 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:41.856573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff4c32-35ca-48e3-a053-6a37e08eda08 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:41.858901 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:41.892946 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23ae68-a6c7-4907-adc0-d6e7d5b9f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:41.894483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23ae68-a6c7-4907-adc0-d6e7d5b9f492 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:41.894991 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23ae68-a6c7-4907-adc0-d6e7d5b9f492 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:41.895488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23ae68-a6c7-4907-adc0-d6e7d5b9f492 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/c4de9bddab3c4a2e9fe8bb0f61123b67/roles/f07994afefe74e7da154dd402f4e2726` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:41.897845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23ae68-a6c7-4907-adc0-d6e7d5b9f492 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=c4de9bddab3c4a2e9fe8bb0f61123b67, role_id=f07994afefe74e7da154dd402f4e2726)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:41.899528 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23ae68-a6c7-4907-adc0-d6e7d5b9f492 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:41.916623 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 330/660] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:28:41 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/c4de9bddab3c4a2e9fe8bb0f61123b67/roles/f07994afefe74e7da154dd402f4e2726 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:28:42.199599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3d640-bf4e-4a3e-804d-ac95f43f852d None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:42.199944 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3d640-bf4e-4a3e-804d-ac95f43f852d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:42.200274 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3d640-bf4e-4a3e-804d-ac95f43f852d None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:42.201901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 331/661] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:42.207783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d4d7-9b14-42de-8416-22403cfc5436 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:42.208069 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d4d7-9b14-42de-8416-22403cfc5436 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:42.208346 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d4d7-9b14-42de-8416-22403cfc5436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:42.228840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bf92d4d7-9b14-42de-8416-22403cfc5436 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:42.230020 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bf92d4d7-9b14-42de-8416-22403cfc5436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:42.305360 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 331/662] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:42 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:42.575829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3d640-bf4e-4a3e-804d-ac95f43f852d None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:42.667988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756c14-aec7-4250-94b9-441f5483f069 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:42.668618 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756c14-aec7-4250-94b9-441f5483f069 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:42.669118 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02756c14-aec7-4250-94b9-441f5483f069 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:42.672132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 332/663] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:42.678561 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77e96a-fce6-4878-b871-6f69f9263e90 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:42.679192 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77e96a-fce6-4878-b871-6f69f9263e90 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:42.679815 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77e96a-fce6-4878-b871-6f69f9263e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:42.683797 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3d640-bf4e-4a3e-804d-ac95f43f852d None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:42.699642 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3f77e96a-fce6-4878-b871-6f69f9263e90 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:42.701233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3f77e96a-fce6-4878-b871-6f69f9263e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:42.719601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:42.720232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:42.720508 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:42.720781 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:42.721482 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:42.723626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:42.732803 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:42.733772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:42.734662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:42.739406 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 332/664] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 18 11:28:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:42.740963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:42.768123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:42.788051 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 333/665] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:42 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:42.862134 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f231-e8f2-4560-9bb0-4fda648ae3cc None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:42.899847 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:42.900794 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:42.901329 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:42.901794 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:42.902606 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:42.903116 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:42.904669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:42.909995 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 333/666] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:42.917657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77e96a-fce6-4878-b871-6f69f9263e90 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:42.946649 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:43.029994 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77e96a-fce6-4878-b871-6f69f9263e90 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:43.068128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:43.069483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:43.070089 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:43.070529 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:43.070798 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:43.071452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:43.071811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:43.073167 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:43.079852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 334/667] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:43.088085 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:43.173276 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:43.186073 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8d1f4-0152-4d0e-b8b9-8cedef5ddb41 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:43.195281 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:43.212686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae5496-f5f5-4750-9b66-df0ba0ed2ebe None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:43.222301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b3cb4-6fea-4ce9-84f4-0fa5e7f4ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:43.222918 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b3cb4-6fea-4ce9-84f4-0fa5e7f4ea7f None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:43.223194 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b3cb4-6fea-4ce9-84f4-0fa5e7f4ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:43.223493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b3cb4-6fea-4ce9-84f4-0fa5e7f4ea7f None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:43.224143 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b3cb4-6fea-4ce9-84f4-0fa5e7f4ea7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:43.225491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b3cb4-6fea-4ce9-84f4-0fa5e7f4ea7f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:43.243709 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 334/668] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:28:43 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:28:43.244734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a351b2-49f5-4dcb-b30b-6523c89e607b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:43.245014 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a351b2-49f5-4dcb-b30b-6523c89e607b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:43.245279 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a351b2-49f5-4dcb-b30b-6523c89e607b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:43.246527 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 335/669] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:43.252140 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9f0c-c577-4a73-8832-62ad62680544 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:43.252473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9f0c-c577-4a73-8832-62ad62680544 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:43.252689 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c9f0c-c577-4a73-8832-62ad62680544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:43.270928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:43.272862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:43.273660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:43.274099 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:43.275031 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] RBAC: Adding query filter params (interface=public, service_id=1c520b0b47ce424492cb088b107fd986, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:43.275527 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:43.277158 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:43.278135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ec5c9f0c-c577-4a73-8832-62ad62680544 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:43.279483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ec5c9f0c-c577-4a73-8832-62ad62680544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:43.291385 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 335/670] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 18 11:28:43 2022] GET /identity/v3/endpoints?service_id=1c520b0b47ce424492cb088b107fd986&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:43.293489 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:43.371964 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 336/671] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:43 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:43.421824 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854213e-f111-4564-8de9-5eb7abe9a0c5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:43.462259 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb0f6a-ad10-4b68-96b5-0f30c54f9674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:43.462870 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0f6a-ad10-4b68-96b5-0f30c54f9674 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:43.463147 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0f6a-ad10-4b68-96b5-0f30c54f9674 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:43.463489 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0f6a-ad10-4b68-96b5-0f30c54f9674 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:43.464093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb0f6a-ad10-4b68-96b5-0f30c54f9674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:43.465461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb0f6a-ad10-4b68-96b5-0f30c54f9674 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:43.472417 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 336/672] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:28:43 2022] GET /identity/v3/services => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 18 11:28:43.656122 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c9f0c-c577-4a73-8832-62ad62680544 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:43.740089 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:43.765404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c9f0c-c577-4a73-8832-62ad62680544 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:43.802248 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f9f2b-8dea-4f8d-b53f-bcf4abb9bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:43.802858 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9f2b-8dea-4f8d-b53f-bcf4abb9bc35 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:43.803129 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9f2b-8dea-4f8d-b53f-bcf4abb9bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:43.803429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f9f2b-8dea-4f8d-b53f-bcf4abb9bc35 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:43.804076 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f9f2b-8dea-4f8d-b53f-bcf4abb9bc35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:43.805727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f9f2b-8dea-4f8d-b53f-bcf4abb9bc35 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:43.827201 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 337/673] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:28:43 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:44.136826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690ac4-73fd-4273-b4a8-3b2c3f19a9ef None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:44.137212 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690ac4-73fd-4273-b4a8-3b2c3f19a9ef None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:44.137413 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690ac4-73fd-4273-b4a8-3b2c3f19a9ef None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:44.138969 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 337/674] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:44.144740 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf6db-fb6d-4a84-8246-6eb657e585be None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:44.145015 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf6db-fb6d-4a84-8246-6eb657e585be None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:44.145289 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf6db-fb6d-4a84-8246-6eb657e585be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:44.163621 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-89ecf6db-fb6d-4a84-8246-6eb657e585be None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:44.164783 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-89ecf6db-fb6d-4a84-8246-6eb657e585be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:44.243661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 338/675] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:44.511759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70690ac4-73fd-4273-b4a8-3b2c3f19a9ef None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:44.528012 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:44.622063 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70690ac4-73fd-4273-b4a8-3b2c3f19a9ef None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:44.658777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29830-de98-4cf8-96fe-bcbfaf4691b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:44.659764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29830-de98-4cf8-96fe-bcbfaf4691b6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:44.660186 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29830-de98-4cf8-96fe-bcbfaf4691b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:44.660602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29830-de98-4cf8-96fe-bcbfaf4691b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:44.671158 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29830-de98-4cf8-96fe-bcbfaf4691b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b8a29830-de98-4cf8-96fe-bcbfaf4691b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:28:44.676696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:44.677840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 11:28:44.678907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:44.681283 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 338/676] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 18 11:28:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:44.687292 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf6db-fb6d-4a84-8246-6eb657e585be None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:44.749886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:44.789321 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf6db-fb6d-4a84-8246-6eb657e585be None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:44.830987 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:44.831870 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:44.832411 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:44.832842 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:44.833660 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:44.834114 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:44.835676 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:44.847429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 339/677] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Oct 18 11:28:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:44.855290 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29830-de98-4cf8-96fe-bcbfaf4691b6 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:44.930348 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:44.965098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29830-de98-4cf8-96fe-bcbfaf4691b6 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:45.001352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:45.001985 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.002262 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.002531 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.013981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:45.015449 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:45.030227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:45.031291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:45.032203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:45.032203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:45.032203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:45.032203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 339/678] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:45.038620 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:45.147432 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbaf8-0cfa-4aec-8f3a-40b878909502 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:45.173283 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:45.182813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:45.183898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.184454 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.185147 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.185781 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:45.186074 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:45.187437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:45.201437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 340/679] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:45.208018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:45.316590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986510f6-174d-4101-ac86-3d058ae8f7d4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:45.341135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:45.353319 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4427b9-e561-4c6e-9594-4e9b439328ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:45.354153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4427b9-e561-4c6e-9594-4e9b439328ec None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.354498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4427b9-e561-4c6e-9594-4e9b439328ec None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.354930 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4427b9-e561-4c6e-9594-4e9b439328ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.363627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4427b9-e561-4c6e-9594-4e9b439328ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:45.365094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4427b9-e561-4c6e-9594-4e9b439328ec None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-0f4427b9-e561-4c6e-9594-4e9b439328ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:45.376921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:45.377862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:45.379150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 340/680] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 18 11:28:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:45.385935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:45.499165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580456c5-dafd-43b9-a6cd-09bec532a7d3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:45.536029 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:45.536629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.536903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.537169 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.537880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:45.538174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:45.539769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:45.558936 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 341/681] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Oct 18 11:28:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:45.560644 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f41c-99a0-4eb4-aa96-b7b1cd27d0a4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.561142 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f41c-99a0-4eb4-aa96-b7b1cd27d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.561221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f41c-99a0-4eb4-aa96-b7b1cd27d0a4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.562609 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 341/682] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:45.565211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:45.570421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98357-8af5-4147-b592-882058cb3573 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.570809 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98357-8af5-4147-b592-882058cb3573 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.571179 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f98357-8af5-4147-b592-882058cb3573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.595197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e0f98357-8af5-4147-b592-882058cb3573 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:45.597759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e0f98357-8af5-4147-b592-882058cb3573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:45.618063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:45.681549 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396bbe8-1557-414f-9b82-22e9a1fed2b7 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:45.725147 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 342/683] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:45.738595 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d523-632f-436f-a8f9-a7c3b6b35729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:45.739816 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d523-632f-436f-a8f9-a7c3b6b35729 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.740268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d523-632f-436f-a8f9-a7c3b6b35729 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.740704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d523-632f-436f-a8f9-a7c3b6b35729 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.842406 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d523-632f-436f-a8f9-a7c3b6b35729 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:45.843096 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d523-632f-436f-a8f9-a7c3b6b35729 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:45.883814 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd220e1-c068-45ea-ac54-a1d5f9ce57b3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.884096 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd220e1-c068-45ea-ac54-a1d5f9ce57b3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.884373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd220e1-c068-45ea-ac54-a1d5f9ce57b3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.889561 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 343/684] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:28:45.891091 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f93f-8d5a-4328-8c45-3598efafc056 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:45.891423 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f93f-8d5a-4328-8c45-3598efafc056 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:45.891701 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906f93f-8d5a-4328-8c45-3598efafc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:45.914915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:45.927752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4906f93f-8d5a-4328-8c45-3598efafc056 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:45.929279 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4906f93f-8d5a-4328-8c45-3598efafc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:46.021922 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 342/685] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:28:45 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:28:46.023085 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d523-632f-436f-a8f9-a7c3b6b35729 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.051874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 344/686] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:46.088071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906f93f-8d5a-4328-8c45-3598efafc056 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.139418 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:46.203537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906f93f-8d5a-4328-8c45-3598efafc056 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.233368 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d523-632f-436f-a8f9-a7c3b6b35729 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.246451 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c861ce0-b4b4-4ce8-83d6-8efcd7b6570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.247796 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c861ce0-b4b4-4ce8-83d6-8efcd7b6570e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.248093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c861ce0-b4b4-4ce8-83d6-8efcd7b6570e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.248361 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c861ce0-b4b4-4ce8-83d6-8efcd7b6570e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.249209 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c861ce0-b4b4-4ce8-83d6-8efcd7b6570e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.251176 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c861ce0-b4b4-4ce8-83d6-8efcd7b6570e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-1c861ce0-b4b4-4ce8-83d6-8efcd7b6570e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:46.262019 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:46.263018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.263911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 345/687] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:46.264734 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216537-2a04-4984-9e80-56b22d1f7c2d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.264734 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216537-2a04-4984-9e80-56b22d1f7c2d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.264856 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216537-2a04-4984-9e80-56b22d1f7c2d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.270778 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 346/688] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:46.271627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28216537-2a04-4984-9e80-56b22d1f7c2d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.274898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee3d2f-8b7c-4d7c-8ca6-f68c5e96da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.275937 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3d2f-8b7c-4d7c-8ca6-f68c5e96da6f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.275937 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3d2f-8b7c-4d7c-8ca6-f68c5e96da6f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.276109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3d2f-8b7c-4d7c-8ca6-f68c5e96da6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.287551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee3d2f-8b7c-4d7c-8ca6-f68c5e96da6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.289075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee3d2f-8b7c-4d7c-8ca6-f68c5e96da6f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.291671 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-afee3d2f-8b7c-4d7c-8ca6-f68c5e96da6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:28:46.304714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:46.305698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:28:46.306703 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:28:46.306703 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:28:46.306703 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:46.306703 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 343/689] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:46.311512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bbd2f-9238-4bef-bb2b-2b45d08a830b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.311799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bbd2f-9238-4bef-bb2b-2b45d08a830b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.312075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bbd2f-9238-4bef-bb2b-2b45d08a830b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.332276 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-6a5bbd2f-9238-4bef-bb2b-2b45d08a830b None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:46.333467 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6a5bbd2f-9238-4bef-bb2b-2b45d08a830b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:46.380474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28216537-2a04-4984-9e80-56b22d1f7c2d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.389517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:46.399656 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 344/690] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:46.400772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bbd2f-9238-4bef-bb2b-2b45d08a830b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.414954 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.415596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.415875 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.416148 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.416772 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:46.417072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.418439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.423288 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 347/691] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:46.428115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.522692 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bbd2f-9238-4bef-bb2b-2b45d08a830b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.533384 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5907-a573-4e03-978c-517a44fe9a42 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.549044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:46.558021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.558626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.558902 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.559174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.559837 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:46.560140 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.561490 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.573024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 345/692] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:46.573612 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.574064 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.574835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.575115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.575421 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.576006 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.577354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:46.587845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:46.588797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.589711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 348/693] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:46.590562 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.627127 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:46.684257 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448a140-75d4-4711-b0df-62b2155f77a5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.696267 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c35639-cafb-4fb5-b306-891fe693715a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.718675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.719308 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.719585 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.719855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.720464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:46.720758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.722138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.726710 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 346/694] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:46.727505 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.733305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.733927 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.734200 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.734466 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.741836 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.743278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:46.754933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:46.755845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 349/695] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:46.756732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.780595 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:46.832743 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb493a4c-6a26-4b8c-863e-fb65061c1214 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.855725 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:46.862896 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411912c-dd97-4a0e-848c-fb1acf9881e4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.866467 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.867069 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.867378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.867652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.868275 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:46.868574 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.869928 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.874497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 347/696] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:46.875268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.900106 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:46.900736 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:46.901011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:46.901280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:46.901856 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:46.903220 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:46.911845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:46.913003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:46.913886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 350/697] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:46.914709 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:46.980532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a20a756-f0de-4f20-a1ae-9109f9e6b472 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:46.994160 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:47.014210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95f9c5-c96e-49b6-af14-06a6cc5ebb18 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.016119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.016718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.016993 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.017260 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.017937 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] RBAC: Adding query filter params (interface=public, service_id=a44607e8a046430bad471f6fba2de7ee, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:47.018236 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.019970 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.025364 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 348/698] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/endpoints?service_id=a44607e8a046430bad471f6fba2de7ee&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:47.030328 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:47.048021 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.048620 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.048898 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.049167 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.050399 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:47.050793 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.052230 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.063304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 351/699] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:47.064082 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:47.085792 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:47.130771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9840-14c3-40d5-9351-07f40346a484 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.162782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f573434-2ed5-4381-bf12-b60361368839 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.163903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.164668 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.164945 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.165211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.165830 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:47.166128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.167500 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.172138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 349/700] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:47.172898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:47.200318 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d112976-bea1-4140-8654-789c72485497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.200947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112976-bea1-4140-8654-789c72485497 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.201225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112976-bea1-4140-8654-789c72485497 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.201495 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d112976-bea1-4140-8654-789c72485497 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.202115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d112976-bea1-4140-8654-789c72485497 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:47.202410 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d112976-bea1-4140-8654-789c72485497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.203788 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d112976-bea1-4140-8654-789c72485497 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.212951 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 352/701] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:47.212951 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d112976-bea1-4140-8654-789c72485497 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:47.215582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:47.275709 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5aee0f-ac27-46cb-a5be-7a5945940942 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.295869 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:47.310675 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73746-5880-487e-8e6a-9bf4a1c724ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.311296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73746-5880-487e-8e6a-9bf4a1c724ed None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.311573 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73746-5880-487e-8e6a-9bf4a1c724ed None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.311841 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73746-5880-487e-8e6a-9bf4a1c724ed None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.312342 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d112976-bea1-4140-8654-789c72485497 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.312436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d73746-5880-487e-8e6a-9bf4a1c724ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.313768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d73746-5880-487e-8e6a-9bf4a1c724ed None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.319909 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 350/702] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:28:47 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:28:47.320742 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73746-5880-487e-8e6a-9bf4a1c724ed None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:47.350653 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.351412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.351690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.351954 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.352687 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] RBAC: Adding query filter params (role.id=f07994afefe74e7da154dd402f4e2726, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=c4de9bddab3c4a2e9fe8bb0f61123b67) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:47.352992 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.354585 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.371312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 353/703] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:28:47 2022] GET /identity/v3/role_assignments?user.id=c4de9bddab3c4a2e9fe8bb0f61123b67&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=f07994afefe74e7da154dd402f4e2726 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:47.371312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:47.455047 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73746-5880-487e-8e6a-9bf4a1c724ed None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.470622 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:47.498009 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743936fc-0077-4062-a216-f5ca7e9be67e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.508347 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e0d7-13b1-434a-9027-f90ba1e52783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.509193 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e0d7-13b1-434a-9027-f90ba1e52783 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.509563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e0d7-13b1-434a-9027-f90ba1e52783 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.510016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e0d7-13b1-434a-9027-f90ba1e52783 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.510785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e0d7-13b1-434a-9027-f90ba1e52783 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.512376 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e0d7-13b1-434a-9027-f90ba1e52783 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.538285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 351/704] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:28:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:47.554981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.555975 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.556439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.556921 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.557835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:47.558334 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.560152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.567769 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 354/705] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:47.574191 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e0d7-13b1-434a-9027-f90ba1e52783 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:47.699592 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e0d7-13b1-434a-9027-f90ba1e52783 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.739907 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb646a-fb46-42bc-b961-bba5dea3f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.740520 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb646a-fb46-42bc-b961-bba5dea3f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.740802 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb646a-fb46-42bc-b961-bba5dea3f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.741078 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb646a-fb46-42bc-b961-bba5dea3f2d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.741775 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb646a-fb46-42bc-b961-bba5dea3f2d1 None admin] RBAC: Adding query filter params (interface=public, service_id=d5d00c3a7ec24898a20d650b3870aa37, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:47.742079 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb646a-fb46-42bc-b961-bba5dea3f2d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.743621 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb646a-fb46-42bc-b961-bba5dea3f2d1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.749908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 352/706] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 18 11:28:47 2022] GET /identity/v3/endpoints?service_id=d5d00c3a7ec24898a20d650b3870aa37&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:47.756420 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:47.768012 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:47.870101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673cd1f-5b3a-4200-ac8c-ab400dd409a2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:47.907552 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54a7af-0137-4ff9-a394-4a85c87e9236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:47.908154 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54a7af-0137-4ff9-a394-4a85c87e9236 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:47.908429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54a7af-0137-4ff9-a394-4a85c87e9236 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:47.908696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54a7af-0137-4ff9-a394-4a85c87e9236 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:47.909813 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54a7af-0137-4ff9-a394-4a85c87e9236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:47.911534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54a7af-0137-4ff9-a394-4a85c87e9236 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:47.922726 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 355/707] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:28:47 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:28:49.589434 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c312-3928-4d8d-b2b9-8e132b9df7b6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:49.589985 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c312-3928-4d8d-b2b9-8e132b9df7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:49.589985 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c312-3928-4d8d-b2b9-8e132b9df7b6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:49.591773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 353/708] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:49.598460 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44d72-3a9f-452a-a3f4-26c6b5214338 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:49.599023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44d72-3a9f-452a-a3f4-26c6b5214338 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:49.599023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44d72-3a9f-452a-a3f4-26c6b5214338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:49.619863 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6cd44d72-3a9f-452a-a3f4-26c6b5214338 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:49.621042 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6cd44d72-3a9f-452a-a3f4-26c6b5214338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:49.692138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 356/709] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:49.695023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fac20-2559-4229-be75-dcce7b362ebd None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:49.695329 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fac20-2559-4229-be75-dcce7b362ebd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:49.695605 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fac20-2559-4229-be75-dcce7b362ebd None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:49.700613 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 354/710] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:49.702194 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee1c6-19dd-49ca-bd9c-86f352eb0f4f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:49.702724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee1c6-19dd-49ca-bd9c-86f352eb0f4f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:49.703207 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee1c6-19dd-49ca-bd9c-86f352eb0f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:49.710698 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:49.722897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-353ee1c6-19dd-49ca-bd9c-86f352eb0f4f None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:49.725020 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-353ee1c6-19dd-49ca-bd9c-86f352eb0f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:49.803596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 357/711] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:49.866384 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373ce2-3a6f-41f0-901d-ccbc774e22b5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:49.866684 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373ce2-3a6f-41f0-901d-ccbc774e22b5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:49.866929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373ce2-3a6f-41f0-901d-ccbc774e22b5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:49.868527 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 355/712] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:49.873727 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787a48-3c27-40d4-80d9-b1f0f0c014b2 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:49.874013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787a48-3c27-40d4-80d9-b1f0f0c014b2 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:49.874286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48787a48-3c27-40d4-80d9-b1f0f0c014b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:49.893404 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-48787a48-3c27-40d4-80d9-b1f0f0c014b2 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:49.895147 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-48787a48-3c27-40d4-80d9-b1f0f0c014b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:49.964508 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 358/713] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:49.993204 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12373ce2-3a6f-41f0-901d-ccbc774e22b5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.022767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:50.095151 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48787a48-3c27-40d4-80d9-b1f0f0c014b2 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.115966 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12373ce2-3a6f-41f0-901d-ccbc774e22b5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.158875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95728239-2f60-4cd2-ba4b-4f4767b156e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.160283 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728239-2f60-4cd2-ba4b-4f4767b156e8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.160283 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728239-2f60-4cd2-ba4b-4f4767b156e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.160536 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95728239-2f60-4cd2-ba4b-4f4767b156e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.161095 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95728239-2f60-4cd2-ba4b-4f4767b156e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.162430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95728239-2f60-4cd2-ba4b-4f4767b156e8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-95728239-2f60-4cd2-ba4b-4f4767b156e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:50.171875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:50.173087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.173956 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 356/714] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:50.174835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec315-b99a-4c09-a313-c56c6663ad31 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.174835 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec315-b99a-4c09-a313-c56c6663ad31 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.175864 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ec315-b99a-4c09-a313-c56c6663ad31 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.177093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 357/715] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:50.179493 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ec315-b99a-4c09-a313-c56c6663ad31 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.180857 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:50.220460 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48787a48-3c27-40d4-80d9-b1f0f0c014b2 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.255360 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd6db5-570b-4068-bf44-f66881f525a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.255992 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6db5-570b-4068-bf44-f66881f525a1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.256273 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6db5-570b-4068-bf44-f66881f525a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.256545 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6db5-570b-4068-bf44-f66881f525a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.257122 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd6db5-570b-4068-bf44-f66881f525a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.258486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd6db5-570b-4068-bf44-f66881f525a1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-2afd6db5-570b-4068-bf44-f66881f525a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:50.267013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:50.268072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:50.274143 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 359/716] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:50.275140 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1123-d1eb-45c9-b679-6d9f06ec9ade None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.275140 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1123-d1eb-45c9-b679-6d9f06ec9ade None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.275140 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1123-d1eb-45c9-b679-6d9f06ec9ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.282932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:50.289280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e94d1123-d1eb-45c9-b679-6d9f06ec9ade None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:50.290462 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e94d1123-d1eb-45c9-b679-6d9f06ec9ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:50.294286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ec315-b99a-4c09-a313-c56c6663ad31 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.328763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.329361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.329638 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.329910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.330534 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:50.330826 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.332297 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.336885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 358/717] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:50.337650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.360597 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 360/718] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:50.361735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d1123-d1eb-45c9-b679-6d9f06ec9ade None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.416359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:50.458858 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fdbb7-bb1c-4d39-b941-8470501d0cd6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.462037 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d1123-d1eb-45c9-b679-6d9f06ec9ade None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.493392 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.494007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.494278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.494582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.495102 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.495795 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.496390 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.496505 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.496657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.496924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.497533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] RBAC: Adding query filter params (name=image) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:50.497826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.499454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:50.507705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:50.508785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:28:50.509629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.510390 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 361/719] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:50.511302 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.514246 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 359/720] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:50.514822 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.539699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:50.615980 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444887-f9a4-4a80-815a-0d5016ceb9ba None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.632126 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641246a2-59ed-42d0-a3e5-39a92b629c4f None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.638649 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:50.652961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.653555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.653832 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.654098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.654710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:50.655002 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.656378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.660980 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 362/721] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:50.661729 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.665184 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.665800 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.666075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.666426 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.667018 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] RBAC: Adding query filter params (type=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:50.667346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.668690 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.673203 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 360/722] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:50.673966 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.766026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:50.784660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98462515-170e-44a1-b14b-fd21c6ec8d55 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.788172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dac927-26a5-4a7d-ae14-583ddbbbd936 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.825492 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.826519 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.827015 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.827668 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.828319 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:50.828627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.830015 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.830973 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.831725 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.832013 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.832511 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.832867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.834238 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:50.840782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 363/723] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:50.840782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:50.852768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:50.854510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:50.855378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 361/724] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:50.856257 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:50.897523 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:50.956435 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d1795-00ab-4d7b-b176-7ee54071be77 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.965211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ac315-a136-47b1-9112-57a044d3d70d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:50.992364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fe4f-035e-49d9-ab9d-8c651dd6f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:50.992990 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fe4f-035e-49d9-ab9d-8c651dd6f81c None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:50.993715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fe4f-035e-49d9-ab9d-8c651dd6f81c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:50.993715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fe4f-035e-49d9-ab9d-8c651dd6f81c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:50.994196 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039fe4f-035e-49d9-ab9d-8c651dd6f81c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:50.995611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039fe4f-035e-49d9-ab9d-8c651dd6f81c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:51.002481 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:51.003121 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:51.003427 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:51.003953 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:51.004577 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:51.004876 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:51.006272 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:51.011137 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 362/725] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:51.011961 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:51.026451 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:51.030394 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 364/726] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:28:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:51.148999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aefca-3d6c-424c-bdaa-37a5b1866811 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:51.198598 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:51.199623 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:51.200130 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:51.200610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:51.201414 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:51.201884 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:51.203578 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:51.210372 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 363/727] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:51.216323 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fe4f-035e-49d9-ab9d-8c651dd6f81c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:51.326744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fe4f-035e-49d9-ab9d-8c651dd6f81c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:51.329226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:51.368958 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15175970-c261-4f01-8c38-b1803e43198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:51.369662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175970-c261-4f01-8c38-b1803e43198a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:51.370011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175970-c261-4f01-8c38-b1803e43198a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:51.370350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15175970-c261-4f01-8c38-b1803e43198a None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:51.371048 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175970-c261-4f01-8c38-b1803e43198a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:51.371448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175970-c261-4f01-8c38-b1803e43198a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:51.372881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15175970-c261-4f01-8c38-b1803e43198a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:51.378433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 365/728] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Oct 18 11:28:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:51.384339 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:51.461959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:51.493674 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0e3b2-804b-4daa-b18d-1ac6aa724614 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:51.528971 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c80014-4137-4f30-9f21-ffcef4a8a2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:51.529659 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80014-4137-4f30-9f21-ffcef4a8a2fc None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:51.529998 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80014-4137-4f30-9f21-ffcef4a8a2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:51.530332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80014-4137-4f30-9f21-ffcef4a8a2fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:51.531056 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c80014-4137-4f30-9f21-ffcef4a8a2fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:51.532486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c80014-4137-4f30-9f21-ffcef4a8a2fc None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:51.557698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 364/729] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:28:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:52.894416 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eff07-193d-49dd-a5a4-6ad751c45206 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:52.894938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eff07-193d-49dd-a5a4-6ad751c45206 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:52.894938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eff07-193d-49dd-a5a4-6ad751c45206 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:52.896579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 366/730] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:52.902121 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006160-b7fd-4fe9-83b5-c5b28d0f0dd6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:52.902570 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006160-b7fd-4fe9-83b5-c5b28d0f0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:52.902646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006160-b7fd-4fe9-83b5-c5b28d0f0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:52.921606 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fc006160-b7fd-4fe9-83b5-c5b28d0f0dd6 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:52.922790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fc006160-b7fd-4fe9-83b5-c5b28d0f0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:52.998031 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 365/731] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:53.266946 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eff07-193d-49dd-a5a4-6ad751c45206 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:53.304501 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e967d5-ef9f-4091-ac82-09e3e51fab21 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:53.304827 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e967d5-ef9f-4091-ac82-09e3e51fab21 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:53.305051 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e967d5-ef9f-4091-ac82-09e3e51fab21 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:53.306494 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 366/732] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:53.311679 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0b7cc-38cd-47d1-bb8c-935964ef12c4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:53.311962 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0b7cc-38cd-47d1-bb8c-935964ef12c4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:53.312236 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0b7cc-38cd-47d1-bb8c-935964ef12c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:53.337520 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d9e0b7cc-38cd-47d1-bb8c-935964ef12c4 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:53.338801 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d9e0b7cc-38cd-47d1-bb8c-935964ef12c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:53.385432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eff07-193d-49dd-a5a4-6ad751c45206 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:53.397346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:53.423420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 367/733] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:53.423420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46798b-6ec1-4885-9dcd-856bd39554e2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:53.423420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46798b-6ec1-4885-9dcd-856bd39554e2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:53.423420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46798b-6ec1-4885-9dcd-856bd39554e2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:53.423420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 368/734] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:53.428476 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c8038-b008-41fe-9de0-04c59c3a6fcc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:53.428839 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c8038-b008-41fe-9de0-04c59c3a6fcc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:53.429183 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c8038-b008-41fe-9de0-04c59c3a6fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:53.430030 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c31de5-ea52-4a33-9265-579d44cd09c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:53.430716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31de5-ea52-4a33-9265-579d44cd09c0 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:53.431075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31de5-ea52-4a33-9265-579d44cd09c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:53.431444 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31de5-ea52-4a33-9265-579d44cd09c0 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:53.432169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c31de5-ea52-4a33-9265-579d44cd09c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:53.433610 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c31de5-ea52-4a33-9265-579d44cd09c0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:53.449885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a63c8038-b008-41fe-9de0-04c59c3a6fcc None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:53.451090 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a63c8038-b008-41fe-9de0-04c59c3a6fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:53.451649 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 367/735] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:28:53 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:53.543813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 369/736] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:53.723432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c31de5-ea52-4a33-9265-579d44cd09c0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:53.756566 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:53.826228 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c8038-b008-41fe-9de0-04c59c3a6fcc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:53.843877 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c31de5-ea52-4a33-9265-579d44cd09c0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:53.882102 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b0df6-f2dd-433c-be3d-6c74dfc1b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:53.882708 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b0df6-f2dd-433c-be3d-6c74dfc1b1bf None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:53.883223 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b0df6-f2dd-433c-be3d-6c74dfc1b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:53.883223 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b0df6-f2dd-433c-be3d-6c74dfc1b1bf None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:53.883909 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b0df6-f2dd-433c-be3d-6c74dfc1b1bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:53.885273 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b0df6-f2dd-433c-be3d-6c74dfc1b1bf None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:53.901564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 368/737] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:28:53 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:53.902604 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836ca5-4e41-4e6a-ae47-e102aa3a9f06 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:53.902887 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836ca5-4e41-4e6a-ae47-e102aa3a9f06 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:53.903159 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63836ca5-4e41-4e6a-ae47-e102aa3a9f06 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:53.904532 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 369/738] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:53.910130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263e8eb-cf93-4e8b-8964-2f4a9fbadb46 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:53.910509 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263e8eb-cf93-4e8b-8964-2f4a9fbadb46 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:53.910787 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263e8eb-cf93-4e8b-8964-2f4a9fbadb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:53.930759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8263e8eb-cf93-4e8b-8964-2f4a9fbadb46 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:53.932148 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8263e8eb-cf93-4e8b-8964-2f4a9fbadb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:53.972267 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c8038-b008-41fe-9de0-04c59c3a6fcc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:53.991065 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:54.024498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 370/739] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:53 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:54.030448 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:54.031568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:54.032087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:54.032592 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:54.033386 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:54.035119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:54.045568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:54.046651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:54.047539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:54.050552 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 370/740] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:54.056303 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263e8eb-cf93-4e8b-8964-2f4a9fbadb46 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:54.073847 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:54.170234 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263e8eb-cf93-4e8b-8964-2f4a9fbadb46 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:54.207726 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:54.208342 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:54.208605 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:54.208868 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:54.209488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:54.209780 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:54.211135 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:54.216753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 371/741] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:54.222744 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:54.318781 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:54.328982 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e71381-80e5-4153-9e1a-77311d82578d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:54.366417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:54.367395 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:54.367893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:54.368461 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:54.369327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:54.369822 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:54.371429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:54.377914 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 371/742] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:54.384092 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:54.423205 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:54.440477 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:54.447748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec21cb9-ab88-4ae4-9f05-4a8089105c55 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:54.485747 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:54.486528 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:54.487277 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:54.487397 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:54.488145 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:54.489669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:54.492596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: WARNING keystone.server.flask.common [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 18 11:28:54.513018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.sql.core [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 11:28:54.513018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 11:28:54.513018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [parameters: {'id': '8efecb1190a7403fa3017e317b562ae6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 11:28:54.513018 dv-cinder-815582-17-smb devstack@keystone.service[81702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8efecb1190a7403fa3017e317b562ae6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8efecb1190a7403fa3017e317b562ae6. Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:28:54.521937 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 11:28:54.522919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application yield resource Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise self.value Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application session.commit() Oct 18 11:28:54.523964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.flush() Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application compat.raise_( Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 11:28:54.530368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 11:28:54.531310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:28:54.533719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [parameters: {'id': '8efecb1190a7403fa3017e317b562ae6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:54.537392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:54.540521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8efecb1190a7403fa3017e317b562ae6. Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 372/743] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Oct 18 11:28:54 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:54.542860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:54.544548 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c508832-fd19-4451-b74e-360aba80d0b4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:54.585969 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:54.586617 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:54.586895 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:54.587215 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:54.587989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] RBAC: Adding query filter params (interface=admin, service_id=a44607e8a046430bad471f6fba2de7ee, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:54.588352 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:54.589709 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:54.600665 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 372/744] 10.222.0.18 () {56 vars in 1249 bytes} [Tue Oct 18 11:28:54 2022] GET /identity/v3/endpoints?service_id=a44607e8a046430bad471f6fba2de7ee&interface=admin®ion_id=RegionOne => generated 193 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:54.601548 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:54.680023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d94786-8245-42b1-9d8a-f3d5bf5916c9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:54.715138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:54.718649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382105eb-863d-4096-a9e4-262b1f9c8416 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:54.729576 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8059178-c2c8-4bf4-97ff-63af90c064b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:54.730892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059178-c2c8-4bf4-97ff-63af90c064b0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:54.731375 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059178-c2c8-4bf4-97ff-63af90c064b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:54.732200 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8059178-c2c8-4bf4-97ff-63af90c064b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:54.734918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:54.744933 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8059178-c2c8-4bf4-97ff-63af90c064b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:54.747537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8059178-c2c8-4bf4-97ff-63af90c064b0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:54.760439 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba372e-a8a7-497f-8947-c8459af54351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:54.761039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba372e-a8a7-497f-8947-c8459af54351 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:54.761311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba372e-a8a7-497f-8947-c8459af54351 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:54.761576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba372e-a8a7-497f-8947-c8459af54351 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:54.762225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba372e-a8a7-497f-8947-c8459af54351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:54.763651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba372e-a8a7-497f-8947-c8459af54351 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-c8059178-c2c8-4bf4-97ff-63af90c064b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:28:54.766103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:54.767149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:54.768301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:28:54.768301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:28:54.768301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:28:54.768301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:28:54.768301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:28:54.768301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:28:54.768301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:28:54.768301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:54.774780 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 373/745] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:28:54 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:28:54.775233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 373/746] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:54.775955 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba372e-a8a7-497f-8947-c8459af54351 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:54.902316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba372e-a8a7-497f-8947-c8459af54351 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:54.942375 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11bd2e-a86f-4554-8993-da4e797e884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:54.942906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11bd2e-a86f-4554-8993-da4e797e884c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:54.943180 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11bd2e-a86f-4554-8993-da4e797e884c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:54.943479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11bd2e-a86f-4554-8993-da4e797e884c None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:54.944207 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11bd2e-a86f-4554-8993-da4e797e884c None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:54.944503 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11bd2e-a86f-4554-8993-da4e797e884c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:54.946172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11bd2e-a86f-4554-8993-da4e797e884c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:54.965405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 374/747] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:55.755635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9803f-2a61-4dab-b647-bcba605986b3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:55.756684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9803f-2a61-4dab-b647-bcba605986b3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:55.757298 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9803f-2a61-4dab-b647-bcba605986b3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:55.761898 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 374/748] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:55.767093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae87b73-dca3-4c61-ac1f-3895fb1dacc1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:55.767550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae87b73-dca3-4c61-ac1f-3895fb1dacc1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:55.767644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae87b73-dca3-4c61-ac1f-3895fb1dacc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:55.786680 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9ae87b73-dca3-4c61-ac1f-3895fb1dacc1 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:55.787943 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9ae87b73-dca3-4c61-ac1f-3895fb1dacc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:55.806631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:55.876771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 375/749] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:55 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:56.149823 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fff982-e537-48e2-b227-75a1bc2ff141 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.150084 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fff982-e537-48e2-b227-75a1bc2ff141 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.150359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fff982-e537-48e2-b227-75a1bc2ff141 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.151752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 375/750] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:56.152760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae87b73-dca3-4c61-ac1f-3895fb1dacc1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:56.156920 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4377c-cc3d-418e-93b9-c7682b2cef34 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.157197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4377c-cc3d-418e-93b9-c7682b2cef34 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.157472 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4377c-cc3d-418e-93b9-c7682b2cef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.176899 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-eef4377c-cc3d-418e-93b9-c7682b2cef34 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:56.178482 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-eef4377c-cc3d-418e-93b9-c7682b2cef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:56.255079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 376/751] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:56 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:56.259590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae87b73-dca3-4c61-ac1f-3895fb1dacc1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:56.298201 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:56.298827 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.299098 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.299486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] PATH_INFO: `/v3/services/image` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.300789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:56.302362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:56.311517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:56.312486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:56.313336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 376/752] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Oct 18 11:28:56 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:56.319084 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4377c-cc3d-418e-93b9-c7682b2cef34 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:56.418994 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4377c-cc3d-418e-93b9-c7682b2cef34 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:56.442749 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:56.453656 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:56.454307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.454583 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.454846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.455488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] RBAC: Adding query filter params (name=image) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:56.455825 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:56.457690 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:56.467336 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 377/753] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:56.468671 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:56.488880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:56.569943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:56.574953 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d69f12-d132-4d84-9d99-9b8e3ec04b15 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:56.616479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:56.617089 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.617370 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.617638 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.618264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] RBAC: Adding query filter params (type=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:56.618562 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:56.619952 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:56.626460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 377/754] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:56.633536 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:56.689273 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603e9a1-8dfb-46aa-b8e7-920214ff7d92 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:56.725763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:56.735036 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:56.735961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.736243 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.736520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.738615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:56.740305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:56.746482 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31260030-2bb6-4a1c-9f15-ed7ad2ea8f01 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:56.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:56.754038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:56.754876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 378/755] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:28:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:56.760259 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:56.788896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:56.790185 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.790785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.791335 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.792278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] RBAC: Adding query filter params (interface=public, service_id=ed5aafdadb9d471eb36a7a61a22663b7, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:56.792758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:56.794388 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:56.801173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 378/756] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 18 11:28:56 2022] GET /identity/v3/endpoints?service_id=ed5aafdadb9d471eb36a7a61a22663b7&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:56.806927 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:56.831643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:56.890731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a28dc-94f6-4847-a67b-b364cbd9e19a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:56.938049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:56.939429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.939939 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.940454 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.940711 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff100a2-cf6f-45ab-8d82-3ac54fd37c24 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:56.941526 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:56.942037 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:56.944576 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:56.951191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 379/757] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:56.958063 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:56.985876 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa1b5a-f48c-41b5-b73d-26bf6c81c48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:56.986543 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa1b5a-f48c-41b5-b73d-26bf6c81c48b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:56.986819 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa1b5a-f48c-41b5-b73d-26bf6c81c48b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:56.987783 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa1b5a-f48c-41b5-b73d-26bf6c81c48b None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:56.988771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa1b5a-f48c-41b5-b73d-26bf6c81c48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:56.990151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa1b5a-f48c-41b5-b73d-26bf6c81c48b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:57.003703 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 379/758] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:28:56 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:28:57.087671 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4714b-f9bd-43db-9535-16f45c62a217 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:57.092946 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de66a08-034d-4c72-a2a4-2cbf15076c4a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.093569 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de66a08-034d-4c72-a2a4-2cbf15076c4a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.094043 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de66a08-034d-4c72-a2a4-2cbf15076c4a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.096707 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 380/759] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:28:57.102117 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb660-c423-4104-9933-200ee14053b2 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.102305 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb660-c423-4104-9933-200ee14053b2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.102585 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edb660-c423-4104-9933-200ee14053b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.108180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:57.127310 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-76edb660-c423-4104-9933-200ee14053b2 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:57.130037 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-76edb660-c423-4104-9933-200ee14053b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:57.131676 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:57.132428 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.132915 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.133237 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.133995 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:57.135288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:57.135412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:57.136603 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:57.144363 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 380/760] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:28:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:57.151307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:57.230650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 381/761] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:57 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:57.274606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164adbc-2207-4d4d-b88f-8a86b72763ad None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:57.294624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3e58-af5e-476c-be07-762348443bda None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.294917 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3e58-af5e-476c-be07-762348443bda None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.295180 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3e58-af5e-476c-be07-762348443bda None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.296758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 382/762] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:28:57.302433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e364-07e1-4cd8-8ad2-90783907b725 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.302715 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e364-07e1-4cd8-8ad2-90783907b725 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.302995 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e364-07e1-4cd8-8ad2-90783907b725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.310471 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:57.311112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.311416 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.311688 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.312378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] RBAC: Adding query filter params (interface=public, service_id=dd8c7e62721948f887e7cded0bbe189e, region_id=RegionOne) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:57.312684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:57.314049 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:57.320302 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 381/763] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 18 11:28:57 2022] GET /identity/v3/endpoints?service_id=dd8c7e62721948f887e7cded0bbe189e&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:57.324025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a3f5e364-07e1-4cd8-8ad2-90783907b725 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:57.325416 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a3f5e364-07e1-4cd8-8ad2-90783907b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:57.328434 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:57.380974 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:57.416632 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 383/764] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:57 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:28:57.443334 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a666c-8844-48e9-bac9-934d816a53fa None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:57.479180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e8637-407a-46ad-8bc4-6a7abdc0d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:57.480087 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e8637-407a-46ad-8bc4-6a7abdc0d419 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.480540 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e8637-407a-46ad-8bc4-6a7abdc0d419 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.481012 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e8637-407a-46ad-8bc4-6a7abdc0d419 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.481807 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e8637-407a-46ad-8bc4-6a7abdc0d419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:57.483336 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e8637-407a-46ad-8bc4-6a7abdc0d419 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:57.490611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 382/765] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:28:57 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:28:57.506532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5e364-07e1-4cd8-8ad2-90783907b725 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:57.587208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:57.622990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5e364-07e1-4cd8-8ad2-90783907b725 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:57.662198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:57.662837 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.663096 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.663404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.663983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:57.665343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:57.675419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:57.676497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:57.677345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 384/766] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Oct 18 11:28:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:57.682864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e8637-407a-46ad-8bc4-6a7abdc0d419 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:57.694677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:57.806443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e8637-407a-46ad-8bc4-6a7abdc0d419 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:57.821565 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:57.854748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:57.855657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.856082 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.856525 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.857496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:57.857999 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:57.859635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:57.870845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 383/767] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:57.872141 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:57.948023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f529b4-9e75-4062-b5ae-c8239beb1b9e None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:57.982265 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd413297-b400-41f8-9d4a-bcb2252f83a0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:57.990245 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:57.990858 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:57.991129 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:57.991452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:57.992671 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:57.994536 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:57.997801 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING keystone.server.flask.common [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 18 11:28:58.007148 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:58.015368 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.sql.core [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 11:28:58.015368 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 18 11:28:58.015368 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [parameters: {'user_id': 'f771dec3b21548f1aee76816e9d83fbe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 18 11:28:58.015368 dv-cinder-815582-17-smb devstack@keystone.service[81703]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81703) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result.read() Oct 18 11:28:58.024355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:28:58.025550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application yield resource Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise self.value Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application session.commit() Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 11:28:58.026696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.session.flush() Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application compat.raise_( Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 11:28:58.027808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:28:58.028868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application result.read() Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:28:58.029903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f771dec3b21548f1aee76816e9d83fbe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:58.031021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 18 11:28:58.032741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 18 11:28:58.035046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 18 11:28:58.035046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 18 11:28:58.035046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 11:28:58.035046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 11:28:58.035046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 18 11:28:58.035046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:58.035046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 385/768] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Oct 18 11:28:57 2022] POST /identity/v3/users => generated 160 bytes in 331 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:58.035046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:58.038150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:58.039008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:58.039526 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:58.039976 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:58.040775 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:58.041246 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:58.042827 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:58.053960 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 384/769] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Oct 18 11:28:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:28:58.055032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:58.092899 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:58.156243 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d578ee-3458-4eed-afdd-659535ab01d0 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:58.159675 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cee93-c33c-4fba-ae55-a44ac498f063 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:58.194992 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714eabd-7a04-4783-87a3-186ec24ba10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:58.196139 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714eabd-7a04-4783-87a3-186ec24ba10f None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:58.196592 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714eabd-7a04-4783-87a3-186ec24ba10f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:58.197035 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714eabd-7a04-4783-87a3-186ec24ba10f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:58.197188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:58.197913 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:58.198254 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:58.198359 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714eabd-7a04-4783-87a3-186ec24ba10f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:58.198596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:58.200091 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714eabd-7a04-4783-87a3-186ec24ba10f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:58.207174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:58.209093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:28:58.225001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:58.226109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:28:58.227054 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 386/770] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:28:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:28:58.227692 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 385/771] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:28:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:28:58.232644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:58.304218 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:58.356727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7acc9-acc6-4fc0-b03b-03aa75f871aa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:58.407195 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c32c1-a390-48b9-b456-4b436e3e8cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:58.408291 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c32c1-a390-48b9-b456-4b436e3e8cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:58.409327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c32c1-a390-48b9-b456-4b436e3e8cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:58.409607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c32c1-a390-48b9-b456-4b436e3e8cf6 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:58.410306 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c32c1-a390-48b9-b456-4b436e3e8cf6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:28:58.410594 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c32c1-a390-48b9-b456-4b436e3e8cf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:58.412099 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c32c1-a390-48b9-b456-4b436e3e8cf6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:58.450477 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 387/772] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Oct 18 11:28:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:28:59.307971 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a67ec-ba25-4d8b-a5bc-a6cd3e07a2dd None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:59.308495 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a67ec-ba25-4d8b-a5bc-a6cd3e07a2dd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:59.308789 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a67ec-ba25-4d8b-a5bc-a6cd3e07a2dd None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:59.310024 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 386/773] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:28:59.316317 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4990931-3eca-45d8-84b9-c0c12a668e21 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:59.316317 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4990931-3eca-45d8-84b9-c0c12a668e21 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:59.316893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4990931-3eca-45d8-84b9-c0c12a668e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:59.335021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e4990931-3eca-45d8-84b9-c0c12a668e21 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:59.336549 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e4990931-3eca-45d8-84b9-c0c12a668e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:59.406811 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 388/774] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:59 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:28:59.671797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a67ec-ba25-4d8b-a5bc-a6cd3e07a2dd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:59.743989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908d6d5-b262-4216-a6a4-134cad939281 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:59.744258 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908d6d5-b262-4216-a6a4-134cad939281 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:59.744529 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908d6d5-b262-4216-a6a4-134cad939281 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:59.745975 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 389/775] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:28:59.750843 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f6ed4-4a06-49b0-b6ad-903859fe762a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:59.751121 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f6ed4-4a06-49b0-b6ad-903859fe762a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:59.751430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f6ed4-4a06-49b0-b6ad-903859fe762a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:59.769654 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:59.769820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-918f6ed4-4a06-49b0-b6ad-903859fe762a None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:28:59.771397 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-918f6ed4-4a06-49b0-b6ad-903859fe762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:28:59.777059 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a67ec-ba25-4d8b-a5bc-a6cd3e07a2dd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:28:59.807497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:28:59.813626 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:28:59.814245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:28:59.814517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:28:59.814784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:28:59.816037 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:28:59.817404 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:28:59.826448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:28:59.827477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 18 11:28:59.828308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:28:59.831614 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 387/776] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Oct 18 11:28:59 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:28:59.834013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:28:59.855120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 390/777] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:28:59 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:29:00.053024 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e72e26-8a27-4151-8931-989b6e61bdd5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:00.087006 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:00.087627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.087900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.088169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.088788 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] RBAC: Adding query filter params (name=image) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:00.089082 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:00.090435 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:00.095444 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 388/778] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:28:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:00.101758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f6ed4-4a06-49b0-b6ad-903859fe762a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:00.123406 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:00.151683 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:00.210034 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f6ed4-4a06-49b0-b6ad-903859fe762a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:00.230344 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d1558-73a3-4aca-b100-0ac245bc1bda None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:00.245447 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:00.246045 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.246526 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.246635 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.247289 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] RBAC: Adding query filter params (type=image) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:00.247514 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:00.248861 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:00.255186 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 391/779] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:00.260787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:00.268681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:00.269321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.269595 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.269864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.270448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:00.271833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:00.280579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:00.281773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:00.282619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 389/780] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:29:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:29:00.288033 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:00.302240 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:00.380763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89a4eb-8ed6-4353-ac10-3dfc485bbf62 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:00.382516 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:00.401349 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87069b0b-6ed1-4492-8f6f-581940044165 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:00.416236 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156a7b1-a1dc-4918-94f1-e14d6a6faaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:00.416837 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a7b1-a1dc-4918-94f1-e14d6a6faaa3 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.417109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a7b1-a1dc-4918-94f1-e14d6a6faaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.417376 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156a7b1-a1dc-4918-94f1-e14d6a6faaa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.418027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156a7b1-a1dc-4918-94f1-e14d6a6faaa3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:00.419385 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156a7b1-a1dc-4918-94f1-e14d6a6faaa3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:00.439053 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:00.439720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.440052 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.440360 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.440945 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:00.441242 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:00.449113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:00.449316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 392/781] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:29:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:29:00.449316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7049-699c-47e0-b488-7cbf89ff91b0 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.449316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7049-699c-47e0-b488-7cbf89ff91b0 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.449316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff7049-699c-47e0-b488-7cbf89ff91b0 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.450103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 393/782] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:29:00.454643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 390/783] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:29:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:00.457075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba4df-8fa8-4510-9e8d-17c3b66ad3cf None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.457376 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba4df-8fa8-4510-9e8d-17c3b66ad3cf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.457650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba4df-8fa8-4510-9e8d-17c3b66ad3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.461648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:00.478325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-572ba4df-8fa8-4510-9e8d-17c3b66ad3cf None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:00.480211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-572ba4df-8fa8-4510-9e8d-17c3b66ad3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:00.572287 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 394/784] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:00 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:29:00.575792 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99d13c-62c8-4f0f-b43e-530667bdd2c1 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:00.614255 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:00.615134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.615576 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.616015 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.616650 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:00.616947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:00.618303 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:00.623792 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 391/785] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Oct 18 11:29:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:00.630281 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ba4df-8fa8-4510-9e8d-17c3b66ad3cf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:00.649104 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:00.733730 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ba4df-8fa8-4510-9e8d-17c3b66ad3cf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:00.768727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647035d-00f9-4341-b36e-eb5fb7ed5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:00.769334 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647035d-00f9-4341-b36e-eb5fb7ed5069 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:00.769608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647035d-00f9-4341-b36e-eb5fb7ed5069 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:00.769871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647035d-00f9-4341-b36e-eb5fb7ed5069 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:00.770538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647035d-00f9-4341-b36e-eb5fb7ed5069 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:00.771919 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647035d-00f9-4341-b36e-eb5fb7ed5069 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:00.799282 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 395/786] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:29:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:29:00.849681 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:00.870647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:00.962228 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b73bc-5e71-45d9-bcb9-862442705eeb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:01.007948 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5f1fb-4202-46ff-a562-bd853f6bb91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:01.008574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f1fb-4202-46ff-a562-bd853f6bb91d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:01.008846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f1fb-4202-46ff-a562-bd853f6bb91d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:01.009109 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5f1fb-4202-46ff-a562-bd853f6bb91d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:01.010185 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5f1fb-4202-46ff-a562-bd853f6bb91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:01.011620 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5f1fb-4202-46ff-a562-bd853f6bb91d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:01.013311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 392/787] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:01.020971 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647035d-00f9-4341-b36e-eb5fb7ed5069 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:01.098548 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:01.139499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647035d-00f9-4341-b36e-eb5fb7ed5069 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:01.175325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016348c1-6af2-456d-8fdb-315bdc6cccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:01.176119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016348c1-6af2-456d-8fdb-315bdc6cccc6 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:01.176394 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016348c1-6af2-456d-8fdb-315bdc6cccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:01.176658 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016348c1-6af2-456d-8fdb-315bdc6cccc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:01.177304 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016348c1-6af2-456d-8fdb-315bdc6cccc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:01.178699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016348c1-6af2-456d-8fdb-315bdc6cccc6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:01.215384 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 396/788] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:29:01 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:29:02.677451 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd0c9-878e-48ec-abab-d667dd86f9e5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:02.678014 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd0c9-878e-48ec-abab-d667dd86f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:02.678014 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cd0c9-878e-48ec-abab-d667dd86f9e5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:02.679336 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 393/789] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:02.684722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380753c2-8e0a-4089-bac2-5e43e0578873 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:02.685132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380753c2-8e0a-4089-bac2-5e43e0578873 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:02.685311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380753c2-8e0a-4089-bac2-5e43e0578873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:02.703741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-380753c2-8e0a-4089-bac2-5e43e0578873 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:02.704915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-380753c2-8e0a-4089-bac2-5e43e0578873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:02.770750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 397/790] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:03.040021 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd0c9-878e-48ec-abab-d667dd86f9e5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:03.055921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfefe-5801-4e89-b60f-8032a74d68b1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.056207 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfefe-5801-4e89-b60f-8032a74d68b1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.057069 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cfefe-5801-4e89-b60f-8032a74d68b1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.058399 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 398/791] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:03.063566 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006225d7-3270-44e7-98b2-d1b91e586320 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.063846 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006225d7-3270-44e7-98b2-d1b91e586320 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.064116 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006225d7-3270-44e7-98b2-d1b91e586320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.083342 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-006225d7-3270-44e7-98b2-d1b91e586320 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:03.084459 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-006225d7-3270-44e7-98b2-d1b91e586320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:03.130115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:03.142334 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:03.152138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cd0c9-878e-48ec-abab-d667dd86f9e5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:03.162974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 399/792] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:29:03.187285 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:03.187903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.188180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.188450 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.189117 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:03.190494 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:03.199352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.sql.core [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 11:29:03.199352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 11:29:03.199352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [parameters: {'id': '31af92ef78d846aea01d712d0d99c857', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 11:29:03.199352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81702) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:29:03.209219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 18 11:29:03.210095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application yield resource Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application next(self.gen) Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.rollback() Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.force_reraise() Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise self.value Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application session.commit() Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 18 11:29:03.211094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._prepare_impl() Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.session.flush() Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._flush(objects) Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application compat.raise_( Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application flush_context.execute() Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rec.execute(self) Oct 18 11:29:03.212536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 18 11:29:03.214190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result = self._query(query) Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application conn.query(q) Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application result.read() Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 18 11:29:03.216130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [parameters: {'id': '31af92ef78d846aea01d712d0d99c857', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 18 11:29:03.218316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:03.220392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:03.224696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 394/793] 10.222.0.18 () {60 vars in 1137 bytes} [Tue Oct 18 11:29:03 2022] POST /identity/v3/domains => generated 190 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:03.226609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006225d7-3270-44e7-98b2-d1b91e586320 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:03.334833 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006225d7-3270-44e7-98b2-d1b91e586320 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:03.370875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c8993-1f75-488e-9c70-9e40a1ad74d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:03.372614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c8993-1f75-488e-9c70-9e40a1ad74d1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.372614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c8993-1f75-488e-9c70-9e40a1ad74d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.372614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c8993-1f75-488e-9c70-9e40a1ad74d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.383600 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c8993-1f75-488e-9c70-9e40a1ad74d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:03.385080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c8993-1f75-488e-9c70-9e40a1ad74d1 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7d7c8993-1f75-488e-9c70-9e40a1ad74d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:29:03.401177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:03.402220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:29:03.403208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:29:03.403208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:03.403208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:03.407458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 400/794] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:03.408258 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:03.427480 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29183c-9705-4573-9edd-c25ca0a9a82d None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.427810 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29183c-9705-4573-9edd-c25ca0a9a82d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.428032 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29183c-9705-4573-9edd-c25ca0a9a82d None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.429504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 401/795] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:03.434664 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29527f3-8f89-4af8-bac5-18caa3398474 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.434950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29527f3-8f89-4af8-bac5-18caa3398474 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.435228 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29527f3-8f89-4af8-bac5-18caa3398474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.454337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f29527f3-8f89-4af8-bac5-18caa3398474 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:03.456353 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f29527f3-8f89-4af8-bac5-18caa3398474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:03.486910 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:03.529373 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 402/796] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:29:03.531475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29527f3-8f89-4af8-bac5-18caa3398474 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:03.532934 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70acc3b-6bfd-411e-b145-463fe90fc062 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:03.572163 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:03.572771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.573044 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.573309 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.574065 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:03.574360 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:03.575846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:03.593301 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 395/797] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:03.664882 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29527f3-8f89-4af8-bac5-18caa3398474 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:03.706568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9275b85-5eb6-47dc-9e05-dc2098364124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:03.708096 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9275b85-5eb6-47dc-9e05-dc2098364124 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.708378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9275b85-5eb6-47dc-9e05-dc2098364124 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.708654 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9275b85-5eb6-47dc-9e05-dc2098364124 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.721268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9275b85-5eb6-47dc-9e05-dc2098364124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c9275b85-5eb6-47dc-9e05-dc2098364124 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:29:03.726475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:03.731612 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:03.732472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 403/798] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 18 11:29:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:03.735011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:03.739824 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:03.846628 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9275b85-5eb6-47dc-9e05-dc2098364124 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:03.874417 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bf474-512e-4129-8c71-92194315812e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:03.893847 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:03.926079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:03.926975 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:03.927299 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:03.927563 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:03.928270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:03.928528 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:03.929897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:03.942297 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 396/799] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Oct 18 11:29:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:03.950298 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:03.989519 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9275b85-5eb6-47dc-9e05-dc2098364124 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:04.023058 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:04.029151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87725-46a3-41cb-ab1b-e65ad6243da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:04.029787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87725-46a3-41cb-ab1b-e65ad6243da4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:04.030063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87725-46a3-41cb-ab1b-e65ad6243da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:04.030335 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a87725-46a3-41cb-ab1b-e65ad6243da4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:04.031460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a87725-46a3-41cb-ab1b-e65ad6243da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:04.032887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a87725-46a3-41cb-ab1b-e65ad6243da4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:04.034494 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 404/800] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:04.040165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87725-46a3-41cb-ab1b-e65ad6243da4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:04.058342 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc24db-fec3-42ac-b24b-b8df12cb5bdd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:04.091752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:04.092377 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:04.092657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:04.092932 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:04.103362 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:04.104735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:29:04.119086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:04.120270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:29:04.121341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:29:04.121341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:04.121341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:04.121341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 397/801] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:29:04.125931 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:04.137466 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:04.145316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a87725-46a3-41cb-ab1b-e65ad6243da4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:04.178770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66707cca-352d-4c67-8759-440f17a2a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:04.179415 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707cca-352d-4c67-8759-440f17a2a91b None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:04.179691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707cca-352d-4c67-8759-440f17a2a91b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:04.179961 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707cca-352d-4c67-8759-440f17a2a91b None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:04.180607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66707cca-352d-4c67-8759-440f17a2a91b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:04.182016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66707cca-352d-4c67-8759-440f17a2a91b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:04.204991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 405/802] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:29:04 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:29:04.230885 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580aa1-4e1a-44bf-bc71-d1c95ba181d3 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:04.250803 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:04.269653 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:04.270285 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:04.270560 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:04.270827 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:04.271506 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:04.271804 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:04.273185 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:04.286465 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 398/803] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:04.292550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66707cca-352d-4c67-8759-440f17a2a91b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:04.399009 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66707cca-352d-4c67-8759-440f17a2a91b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:04.433162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:04.433782 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:04.434056 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:04.434327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:04.441728 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:04.443147 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:29:04.454039 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:04.455107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:04.456264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 406/804] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 18 11:29:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:04.461034 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:04.559534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1670dcf-202c-4895-a1e2-df3db39a0fe0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:04.592991 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:04.593585 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:04.593861 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:04.594132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:04.594846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:04.595148 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:04.597204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:04.614787 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 399/805] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 18 11:29:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:04.620647 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:04.633927 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:04.721746 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44e1ce-a1ef-4b4a-bf86-6fe04c2a0ed4 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:04.753955 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:04.754565 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:04.754841 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:04.755110 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:04.765195 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:04.766614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:29:04.780871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:04.781908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:29:04.782834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:29:04.782834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:04.782834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:04.782834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 407/806] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:04.788499 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:04.823409 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:04.887095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac276d-07b7-4928-8f83-f91f0b7fc60a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:04.920415 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:04.921009 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:04.921284 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:04.921552 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:04.922181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:04.922479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:04.923874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:04.935580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 400/807] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:04.941925 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:05.000636 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:05.039705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcc673-3d10-48d6-be41-30d95f25e031 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:05.072652 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:05.073274 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:05.073550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:05.073820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:05.080183 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:05.081700 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:29:05.092560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:05.093452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:05.094844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 408/808] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:05.100099 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:05.192564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:05.198671 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692e903-8f1f-4cd5-8685-3cf85544cd09 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:05.230846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202314f-14c4-433e-ac34-207e83f1505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:05.231463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202314f-14c4-433e-ac34-207e83f1505c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:05.231740 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202314f-14c4-433e-ac34-207e83f1505c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:05.232008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202314f-14c4-433e-ac34-207e83f1505c None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:05.232676 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202314f-14c4-433e-ac34-207e83f1505c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:05.232974 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202314f-14c4-433e-ac34-207e83f1505c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:05.234371 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202314f-14c4-433e-ac34-207e83f1505c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:05.246428 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 401/809] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:05.252477 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:05.349402 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69491394-1f8b-461e-bdf3-c338929c856d None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:05.371909 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:05.384023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df4c2c-7b83-45d5-9b47-5748e9e40955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:05.384661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df4c2c-7b83-45d5-9b47-5748e9e40955 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:05.384935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df4c2c-7b83-45d5-9b47-5748e9e40955 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:05.385200 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df4c2c-7b83-45d5-9b47-5748e9e40955 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/0a286777ff794c7a973a07881c195de1/roles/f07994afefe74e7da154dd402f4e2726` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:05.387291 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df4c2c-7b83-45d5-9b47-5748e9e40955 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=0a286777ff794c7a973a07881c195de1, role_id=f07994afefe74e7da154dd402f4e2726)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:05.388706 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df4c2c-7b83-45d5-9b47-5748e9e40955 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:05.403734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 409/810] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:29:05 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/0a286777ff794c7a973a07881c195de1/roles/f07994afefe74e7da154dd402f4e2726 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:29:06.410883 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67317b22-341d-4d6f-a18a-c6f6eeb74064 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:06.411437 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67317b22-341d-4d6f-a18a-c6f6eeb74064 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:06.411526 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67317b22-341d-4d6f-a18a-c6f6eeb74064 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:06.412825 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 402/811] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:06.418168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14cdc1-4598-4aec-a72c-24de3a738928 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:06.418582 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14cdc1-4598-4aec-a72c-24de3a738928 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:06.418828 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14cdc1-4598-4aec-a72c-24de3a738928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:06.437002 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4e14cdc1-4598-4aec-a72c-24de3a738928 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:06.438166 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4e14cdc1-4598-4aec-a72c-24de3a738928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:06.503714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 410/812] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:06.770902 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67317b22-341d-4d6f-a18a-c6f6eeb74064 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:06.869789 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67317b22-341d-4d6f-a18a-c6f6eeb74064 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:06.903584 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd5c56-3c9d-44ea-9a02-7e5818398bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:06.904196 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5c56-3c9d-44ea-9a02-7e5818398bed None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:06.904474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5c56-3c9d-44ea-9a02-7e5818398bed None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:06.904748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd5c56-3c9d-44ea-9a02-7e5818398bed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:06.914674 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd5c56-3c9d-44ea-9a02-7e5818398bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b2cd5c56-3c9d-44ea-9a02-7e5818398bed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:29:06.919440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:06.920520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:06.924388 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 403/813] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:06.926602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14cdc1-4598-4aec-a72c-24de3a738928 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:07.024023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14cdc1-4598-4aec-a72c-24de3a738928 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:07.037325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:07.059006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:07.059628 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:07.059905 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:07.060176 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:07.060825 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:07.061123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:07.062463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:07.070387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 411/814] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:07.076149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd5c56-3c9d-44ea-9a02-7e5818398bed None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:07.094870 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:07.176811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd5c56-3c9d-44ea-9a02-7e5818398bed None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:07.210570 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808578a7-a85c-4f64-89be-785359a8e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:07.211190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808578a7-a85c-4f64-89be-785359a8e672 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:07.211487 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808578a7-a85c-4f64-89be-785359a8e672 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:07.211758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808578a7-a85c-4f64-89be-785359a8e672 None admin] PATH_INFO: `/v3/users/d867a12d25534b43ac96c13cd371da8a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:07.225417 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808578a7-a85c-4f64-89be-785359a8e672 None admin] RBAC: Authorizing `identity:get_user(user_id=d867a12d25534b43ac96c13cd371da8a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:07.226839 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808578a7-a85c-4f64-89be-785359a8e672 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:07.228661 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 404/815] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:07 2022] GET /identity/v3/users/d867a12d25534b43ac96c13cd371da8a => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:07.234178 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:07.331391 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a5fb1-7805-4566-8d09-a10e7e095a3c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:07.363522 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8e7fe-972a-4fcb-a234-7a08692c886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:07.364140 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8e7fe-972a-4fcb-a234-7a08692c886b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:07.364424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8e7fe-972a-4fcb-a234-7a08692c886b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:07.364692 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8e7fe-972a-4fcb-a234-7a08692c886b None admin] PATH_INFO: `/v3/projects/b09410b07f4f4099bbb8186af3042b72` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:07.365798 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8e7fe-972a-4fcb-a234-7a08692c886b None admin] RBAC: Authorizing `identity:get_project(project_id=b09410b07f4f4099bbb8186af3042b72)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:07.367206 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8e7fe-972a-4fcb-a234-7a08692c886b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:07.369001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 412/816] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:29:07 2022] GET /identity/v3/projects/b09410b07f4f4099bbb8186af3042b72 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:07.374720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808578a7-a85c-4f64-89be-785359a8e672 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:07.451854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:07.478862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808578a7-a85c-4f64-89be-785359a8e672 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:07.513300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db176dfe-d365-48af-bc1b-519b561110ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:07.513950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db176dfe-d365-48af-bc1b-519b561110ba None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:07.514225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db176dfe-d365-48af-bc1b-519b561110ba None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:07.514491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db176dfe-d365-48af-bc1b-519b561110ba None admin] PATH_INFO: `/v3/projects/b09410b07f4f4099bbb8186af3042b72/users/d867a12d25534b43ac96c13cd371da8a/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:07.516378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db176dfe-d365-48af-bc1b-519b561110ba None admin] RBAC: Authorizing `identity:create_grant(project_id=b09410b07f4f4099bbb8186af3042b72, user_id=d867a12d25534b43ac96c13cd371da8a, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:07.517806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db176dfe-d365-48af-bc1b-519b561110ba None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:07.530818 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 405/817] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:29:07 2022] PUT /identity/v3/projects/b09410b07f4f4099bbb8186af3042b72/users/d867a12d25534b43ac96c13cd371da8a/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:29:07.558787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5a37-6866-4b2c-8e56-a73699a7336a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:07.559393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5a37-6866-4b2c-8e56-a73699a7336a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:07.559393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5a37-6866-4b2c-8e56-a73699a7336a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:07.560748 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 413/818] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:07.567526 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a266a-89cd-42f7-8b4e-ef4d529ce9d7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:07.567860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a266a-89cd-42f7-8b4e-ef4d529ce9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:07.568131 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a266a-89cd-42f7-8b4e-ef4d529ce9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:07.589174 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-733a266a-89cd-42f7-8b4e-ef4d529ce9d7 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:07.590291 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-733a266a-89cd-42f7-8b4e-ef4d529ce9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:07.661900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 406/819] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:07.935489 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5a37-6866-4b2c-8e56-a73699a7336a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:07.980338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:08.038050 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5a37-6866-4b2c-8e56-a73699a7336a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:08.071082 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a86a7-1399-4543-9622-a3a34309ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:08.071755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a86a7-1399-4543-9622-a3a34309ccfa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:08.072031 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a86a7-1399-4543-9622-a3a34309ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:08.072301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a86a7-1399-4543-9622-a3a34309ccfa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:08.082578 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a86a7-1399-4543-9622-a3a34309ccfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-501a86a7-1399-4543-9622-a3a34309ccfa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:29:08.087337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:08.088437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:08.089285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 414/820] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Oct 18 11:29:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:08.094370 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a266a-89cd-42f7-8b4e-ef4d529ce9d7 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:08.154115 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:08.192901 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a266a-89cd-42f7-8b4e-ef4d529ce9d7 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:08.227562 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:08.228164 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:08.228440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:08.228709 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:08.229369 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:08.229664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:08.231017 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:08.240257 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 407/821] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Oct 18 11:29:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:08.245873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a86a7-1399-4543-9622-a3a34309ccfa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:08.343898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a86a7-1399-4543-9622-a3a34309ccfa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:08.345371 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:08.380614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:08.381224 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:08.381496 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:08.381848 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:08.392005 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:08.394051 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:29:08.411449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:08.412545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:29:08.413431 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:29:08.413431 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:08.413431 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:08.413431 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 415/822] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:08.418243 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:08.515631 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980476e4-8c97-4837-abec-f5ca2d745ae4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:08.541269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:08.550529 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:08.551121 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:08.551429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:08.551701 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:08.552325 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:08.552621 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:08.553974 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:08.565766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 408/823] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:08.571343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:08.669397 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac51866-a636-4334-855b-d7b59594ade5 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:08.701767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:08.702398 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:08.702669 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:08.702932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] PATH_INFO: `/v3/users/nova` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:08.711317 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:08.712724 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:29:08.724512 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:08.725464 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:08.726484 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 416/824] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Oct 18 11:29:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:08.731373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:08.832897 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419029f-d2ad-46d7-9675-72aaca4dc09f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:08.866046 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:08.866630 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:08.866904 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:08.867171 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:08.867911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:08.868210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:08.869619 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:08.887022 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 409/825] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Oct 18 11:29:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:08.892719 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:08.909514 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:08.990750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce7c91-08b3-4e6e-a15b-6c5ddcacf7af None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:09.024315 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95badf93-7d0a-4917-847b-d43dccc08a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:09.024908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badf93-7d0a-4917-847b-d43dccc08a05 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:09.025187 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badf93-7d0a-4917-847b-d43dccc08a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:09.025456 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95badf93-7d0a-4917-847b-d43dccc08a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:09.090748 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95badf93-7d0a-4917-847b-d43dccc08a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:09.092141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95badf93-7d0a-4917-847b-d43dccc08a05 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:09.106150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:09.189001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 417/826] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:29:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:29:09.195676 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:09.241852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:09.295390 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e4d37-6f5a-4b9b-b828-6bf526962f25 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:09.330004 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:09.331197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:09.331499 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:09.331767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:09.341483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:09.342879 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:29:09.357557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:09.358606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:29:09.359535 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:29:09.359535 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:29:09.359535 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:09.359535 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 410/827] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:09.364993 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95badf93-7d0a-4917-847b-d43dccc08a05 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:09.464901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95badf93-7d0a-4917-847b-d43dccc08a05 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:09.479588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:09.500621 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50e97b-9b20-478f-9dc6-42d0dc9db4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:09.501325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e97b-9b20-478f-9dc6-42d0dc9db4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:09.501756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e97b-9b20-478f-9dc6-42d0dc9db4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:09.502140 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50e97b-9b20-478f-9dc6-42d0dc9db4f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:09.502854 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50e97b-9b20-478f-9dc6-42d0dc9db4f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:09.503427 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50e97b-9b20-478f-9dc6-42d0dc9db4f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:09.504773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50e97b-9b20-478f-9dc6-42d0dc9db4f6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:09.516075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 418/828] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:09.522442 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:09.619258 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:09.625752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8c526-372b-45ec-a465-ad60440914f5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:09.659203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:09.659854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:09.660130 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:09.660398 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:09.666907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:09.668364 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:29:09.679300 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:09.680329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:09.681254 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 411/829] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:09.684310 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edf6e1-971b-4428-bfef-a0e4f1077be3 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:09.684773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edf6e1-971b-4428-bfef-a0e4f1077be3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:09.684865 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edf6e1-971b-4428-bfef-a0e4f1077be3 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:09.685978 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:09.686429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 419/830] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:09.691532 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d549ec-73ac-4da1-8176-6966e8e03fbd None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:09.691805 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d549ec-73ac-4da1-8176-6966e8e03fbd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:09.692068 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d549ec-73ac-4da1-8176-6966e8e03fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:09.710747 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-70d549ec-73ac-4da1-8176-6966e8e03fbd None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:09.711941 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-70d549ec-73ac-4da1-8176-6966e8e03fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:09.782958 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 420/831] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:29:09.784627 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265fd0-2f41-423a-81a1-25d96e80939a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:09.816703 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:09.817294 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:09.817564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:09.817835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:09.818488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:09.818784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:09.820214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:09.832769 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 412/832] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:09.839141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d549ec-73ac-4da1-8176-6966e8e03fbd None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:09.935162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d549ec-73ac-4da1-8176-6966e8e03fbd None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:09.937351 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:09.969178 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:09.969770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:09.970047 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:09.970321 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:09.971029 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] RBAC: Adding query filter params (role.id=f07994afefe74e7da154dd402f4e2726, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=0a286777ff794c7a973a07881c195de1) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:09.971362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:09.972770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:09.978339 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 421/833] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:29:09 2022] GET /identity/v3/role_assignments?user.id=0a286777ff794c7a973a07881c195de1&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=f07994afefe74e7da154dd402f4e2726 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:10.066269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:10.084775 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:10.171606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ecd86-f468-498f-a997-02ecfeabb611 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:10.207279 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219be8a-cf55-4267-bffe-091bc46064e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:10.207876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219be8a-cf55-4267-bffe-091bc46064e0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:10.208160 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219be8a-cf55-4267-bffe-091bc46064e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:10.208430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219be8a-cf55-4267-bffe-091bc46064e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:10.219432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219be8a-cf55-4267-bffe-091bc46064e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b219be8a-cf55-4267-bffe-091bc46064e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:29:10.224720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:10.225733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:10.226580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 413/834] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:29:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:10.231937 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:10.336352 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d606337-fab3-4a80-9368-e2ea13ebd776 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:10.370678 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:10.371308 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:10.371593 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:10.371869 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:10.372521 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:10.372828 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:10.374179 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:10.383342 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 422/835] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:29:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:10.389428 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219be8a-cf55-4267-bffe-091bc46064e0 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:10.469084 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:10.496673 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219be8a-cf55-4267-bffe-091bc46064e0 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:10.531533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae92a8-f871-4c2d-bcee-b43a88549e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:10.532155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae92a8-f871-4c2d-bcee-b43a88549e15 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:10.532409 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae92a8-f871-4c2d-bcee-b43a88549e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:10.532672 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae92a8-f871-4c2d-bcee-b43a88549e15 None admin] PATH_INFO: `/v3/users/d867a12d25534b43ac96c13cd371da8a` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:10.535017 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae92a8-f871-4c2d-bcee-b43a88549e15 None admin] RBAC: Authorizing `identity:get_user(user_id=d867a12d25534b43ac96c13cd371da8a)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:10.536480 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae92a8-f871-4c2d-bcee-b43a88549e15 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:10.538205 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 414/836] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:10 2022] GET /identity/v3/users/d867a12d25534b43ac96c13cd371da8a => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:10.544071 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:10.575544 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:10.648569 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e4e95-08b4-414b-881c-e17c9505d0bb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:10.683768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfc4b8-ff8a-4570-96c2-0147921ac2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:10.684374 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfc4b8-ff8a-4570-96c2-0147921ac2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:10.684926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfc4b8-ff8a-4570-96c2-0147921ac2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:10.684926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfc4b8-ff8a-4570-96c2-0147921ac2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:10.755336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfc4b8-ff8a-4570-96c2-0147921ac2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:10.756698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfc4b8-ff8a-4570-96c2-0147921ac2d8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:10.785916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:10.858280 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 423/837] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:29:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:29:10.864980 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae92a8-f871-4c2d-bcee-b43a88549e15 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:10.961867 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae92a8-f871-4c2d-bcee-b43a88549e15 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:10.993892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff29f-126a-46e0-885b-0d1da98233ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:10.994501 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff29f-126a-46e0-885b-0d1da98233ef None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:10.994774 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff29f-126a-46e0-885b-0d1da98233ef None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:10.995040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff29f-126a-46e0-885b-0d1da98233ef None admin] PATH_INFO: `/v3/projects/b09410b07f4f4099bbb8186af3042b72` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:10.996154 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff29f-126a-46e0-885b-0d1da98233ef None admin] RBAC: Authorizing `identity:get_project(project_id=b09410b07f4f4099bbb8186af3042b72)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:10.997569 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ff29f-126a-46e0-885b-0d1da98233ef None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:10.999154 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 415/838] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:29:10 2022] GET /identity/v3/projects/b09410b07f4f4099bbb8186af3042b72 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:11.005780 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfc4b8-ff8a-4570-96c2-0147921ac2d8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:11.100787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfc4b8-ff8a-4570-96c2-0147921ac2d8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:11.127920 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:11.134409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90ac16-e3c9-4811-93c7-10dac00b84f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:11.134998 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ac16-e3c9-4811-93c7-10dac00b84f7 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:11.135348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ac16-e3c9-4811-93c7-10dac00b84f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:11.135586 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ac16-e3c9-4811-93c7-10dac00b84f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:11.136288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90ac16-e3c9-4811-93c7-10dac00b84f7 None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=b09410b07f4f4099bbb8186af3042b72, user.id=d867a12d25534b43ac96c13cd371da8a) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:11.136584 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90ac16-e3c9-4811-93c7-10dac00b84f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:11.137979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90ac16-e3c9-4811-93c7-10dac00b84f7 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:11.144384 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 424/839] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:29:11 2022] GET /identity/v3/role_assignments?user.id=d867a12d25534b43ac96c13cd371da8a&scope.project.id=b09410b07f4f4099bbb8186af3042b72&role.id=78ddf427bf274205867c7492aec1f590 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:13.265977 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cd343-50fe-4ecf-b4b2-dc9d4e20805f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:13.266533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cd343-50fe-4ecf-b4b2-dc9d4e20805f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:13.266533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cd343-50fe-4ecf-b4b2-dc9d4e20805f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:13.267900 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 416/840] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:13.273113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91623e-9a5b-4326-8644-57895143feea None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:13.273543 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91623e-9a5b-4326-8644-57895143feea None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:13.273650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91623e-9a5b-4326-8644-57895143feea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:13.291357 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fc91623e-9a5b-4326-8644-57895143feea None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:13.292528 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fc91623e-9a5b-4326-8644-57895143feea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:13.356766 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 425/841] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:13.623340 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cd343-50fe-4ecf-b4b2-dc9d4e20805f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:13.638963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:13.723104 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cd343-50fe-4ecf-b4b2-dc9d4e20805f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:13.756378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc3362-8f4d-49f9-ad8d-3253468a0ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:13.757006 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc3362-8f4d-49f9-ad8d-3253468a0ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:13.757282 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc3362-8f4d-49f9-ad8d-3253468a0ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:13.757553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc3362-8f4d-49f9-ad8d-3253468a0ec9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:13.758754 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc3362-8f4d-49f9-ad8d-3253468a0ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:13.760497 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc3362-8f4d-49f9-ad8d-3253468a0ec9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:13.762052 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 417/842] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:13.767981 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91623e-9a5b-4326-8644-57895143feea None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:13.867545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91623e-9a5b-4326-8644-57895143feea None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:13.890705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:13.902198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af598-9088-43c7-9dda-6c9161158825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:13.902789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af598-9088-43c7-9dda-6c9161158825 None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:13.903061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af598-9088-43c7-9dda-6c9161158825 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:13.903355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af598-9088-43c7-9dda-6c9161158825 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:13.903984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91af598-9088-43c7-9dda-6c9161158825 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:13.905380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91af598-9088-43c7-9dda-6c9161158825 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:13.926661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 426/843] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:29:13 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 18 11:29:16.099582 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea314-2643-46b8-a880-96263cb2c83b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:16.100101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea314-2643-46b8-a880-96263cb2c83b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:16.100210 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea314-2643-46b8-a880-96263cb2c83b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:16.101496 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 418/844] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:16.106550 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4bb3-330d-4b99-bbf6-c0846f100f17 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:16.106945 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4bb3-330d-4b99-bbf6-c0846f100f17 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:16.107101 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d4bb3-330d-4b99-bbf6-c0846f100f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:16.125319 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-7a8d4bb3-330d-4b99-bbf6-c0846f100f17 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:16.126501 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7a8d4bb3-330d-4b99-bbf6-c0846f100f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:16.191322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 427/845] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:16.461432 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea314-2643-46b8-a880-96263cb2c83b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:16.544054 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:16.564293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea314-2643-46b8-a880-96263cb2c83b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:16.597189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e17ed-ecaf-43a2-923d-63c90c4aff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:16.597790 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e17ed-ecaf-43a2-923d-63c90c4aff3b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:16.598063 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e17ed-ecaf-43a2-923d-63c90c4aff3b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:16.598329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e17ed-ecaf-43a2-923d-63c90c4aff3b None admin] PATH_INFO: `/v3/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:16.599712 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e17ed-ecaf-43a2-923d-63c90c4aff3b None admin] RBAC: Authorizing `identity:get_role(role_id=bfb1cb6dbfcf40ad9ba6b353b461eea6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:16.601059 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e17ed-ecaf-43a2-923d-63c90c4aff3b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:16.602333 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 419/846] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:16 2022] GET /identity/v3/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:29:16.608225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d4bb3-330d-4b99-bbf6-c0846f100f17 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:16.704102 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d4bb3-330d-4b99-bbf6-c0846f100f17 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:16.715194 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:16.739868 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886ceb-a3f7-4bea-82a9-578684c1ffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:16.740480 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886ceb-a3f7-4bea-82a9-578684c1ffa8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:16.740758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886ceb-a3f7-4bea-82a9-578684c1ffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:16.741025 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886ceb-a3f7-4bea-82a9-578684c1ffa8 None admin] PATH_INFO: `/v3/users/4791969dfc8b4498a55e31f6fac37d92` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:16.753872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1886ceb-a3f7-4bea-82a9-578684c1ffa8 None admin] RBAC: Authorizing `identity:get_user(user_id=4791969dfc8b4498a55e31f6fac37d92)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:16.755298 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1886ceb-a3f7-4bea-82a9-578684c1ffa8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:16.756853 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 428/847] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:16 2022] GET /identity/v3/users/4791969dfc8b4498a55e31f6fac37d92 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:16.762569 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e17ed-ecaf-43a2-923d-63c90c4aff3b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:16.859807 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e17ed-ecaf-43a2-923d-63c90c4aff3b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:16.891769 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a67ee-4c9f-47f2-9aa6-20afb54b1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:16.892943 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a67ee-4c9f-47f2-9aa6-20afb54b1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:16.893231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a67ee-4c9f-47f2-9aa6-20afb54b1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:16.893502 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a67ee-4c9f-47f2-9aa6-20afb54b1bd5 None admin] PATH_INFO: `/v3/projects/b09410b07f4f4099bbb8186af3042b72` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:16.894604 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a67ee-4c9f-47f2-9aa6-20afb54b1bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=b09410b07f4f4099bbb8186af3042b72)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:16.896052 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a67ee-4c9f-47f2-9aa6-20afb54b1bd5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:16.897647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 420/848] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:29:16 2022] GET /identity/v3/projects/b09410b07f4f4099bbb8186af3042b72 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:16.903568 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886ceb-a3f7-4bea-82a9-578684c1ffa8 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:16.999393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886ceb-a3f7-4bea-82a9-578684c1ffa8 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:17.033682 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a80bbb-2012-41c1-8789-8555d0dd3c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:17.034480 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80bbb-2012-41c1-8789-8555d0dd3c41 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:17.034756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80bbb-2012-41c1-8789-8555d0dd3c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:17.035027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a80bbb-2012-41c1-8789-8555d0dd3c41 None admin] PATH_INFO: `/v3/projects/b09410b07f4f4099bbb8186af3042b72/users/4791969dfc8b4498a55e31f6fac37d92/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:17.037165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a80bbb-2012-41c1-8789-8555d0dd3c41 None admin] RBAC: Authorizing `identity:create_grant(project_id=b09410b07f4f4099bbb8186af3042b72, user_id=4791969dfc8b4498a55e31f6fac37d92, role_id=bfb1cb6dbfcf40ad9ba6b353b461eea6)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:17.038564 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a80bbb-2012-41c1-8789-8555d0dd3c41 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:17.051213 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 429/849] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:29:16 2022] PUT /identity/v3/projects/b09410b07f4f4099bbb8186af3042b72/users/4791969dfc8b4498a55e31f6fac37d92/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:29:19.167133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a5d7d-63d9-44eb-9bc8-49ee2f03961a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:19.167682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a5d7d-63d9-44eb-9bc8-49ee2f03961a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:19.167682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a5d7d-63d9-44eb-9bc8-49ee2f03961a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:19.169038 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 421/850] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:19.174873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464feb10-8d78-4703-b01c-c78f0c1213f6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:19.175293 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464feb10-8d78-4703-b01c-c78f0c1213f6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:19.175437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464feb10-8d78-4703-b01c-c78f0c1213f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:19.193829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-464feb10-8d78-4703-b01c-c78f0c1213f6 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:19.194998 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-464feb10-8d78-4703-b01c-c78f0c1213f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:19.216946 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:19.261132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 430/851] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:19.532302 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a5d7d-63d9-44eb-9bc8-49ee2f03961a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:19.551498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:19.631508 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a5d7d-63d9-44eb-9bc8-49ee2f03961a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:19.663483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583525b-20f1-4542-8b73-f2646906485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:19.664091 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583525b-20f1-4542-8b73-f2646906485b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:19.664375 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583525b-20f1-4542-8b73-f2646906485b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:19.664629 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583525b-20f1-4542-8b73-f2646906485b None admin] PATH_INFO: `/v3/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:19.665979 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583525b-20f1-4542-8b73-f2646906485b None admin] RBAC: Authorizing `identity:get_role(role_id=bfb1cb6dbfcf40ad9ba6b353b461eea6)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:19.667348 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583525b-20f1-4542-8b73-f2646906485b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:19.668622 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 422/852] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:19 2022] GET /identity/v3/roles/bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:19.675003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464feb10-8d78-4703-b01c-c78f0c1213f6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:19.770046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464feb10-8d78-4703-b01c-c78f0c1213f6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:19.803520 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41cc8a-8ba6-4934-a8ef-00991f3b2e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:19.804151 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41cc8a-8ba6-4934-a8ef-00991f3b2e59 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:19.804422 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41cc8a-8ba6-4934-a8ef-00991f3b2e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:19.804688 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41cc8a-8ba6-4934-a8ef-00991f3b2e59 None admin] PATH_INFO: `/v3/users/4791969dfc8b4498a55e31f6fac37d92` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:19.805834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41cc8a-8ba6-4934-a8ef-00991f3b2e59 None admin] RBAC: Authorizing `identity:get_user(user_id=4791969dfc8b4498a55e31f6fac37d92)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:19.807239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41cc8a-8ba6-4934-a8ef-00991f3b2e59 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:19.808816 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 431/853] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:19 2022] GET /identity/v3/users/4791969dfc8b4498a55e31f6fac37d92 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:19.814843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583525b-20f1-4542-8b73-f2646906485b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:19.897947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:19.914122 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583525b-20f1-4542-8b73-f2646906485b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:19.945832 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cee62a-a733-49ad-8322-ceafb3958d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:19.946416 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cee62a-a733-49ad-8322-ceafb3958d6f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:19.946689 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cee62a-a733-49ad-8322-ceafb3958d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:19.946956 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cee62a-a733-49ad-8322-ceafb3958d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:20.020624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cee62a-a733-49ad-8322-ceafb3958d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:20.022162 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cee62a-a733-49ad-8322-ceafb3958d6f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:20.141356 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:20.158263 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 423/854] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:29:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:29:20.164096 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41cc8a-8ba6-4934-a8ef-00991f3b2e59 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:20.191483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:20.261315 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41cc8a-8ba6-4934-a8ef-00991f3b2e59 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:20.293350 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34211739-634f-4c47-96d4-1f59234836e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:20.293968 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34211739-634f-4c47-96d4-1f59234836e9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:20.294242 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34211739-634f-4c47-96d4-1f59234836e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:20.294514 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34211739-634f-4c47-96d4-1f59234836e9 None admin] PATH_INFO: `/v3/projects/b09410b07f4f4099bbb8186af3042b72` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:20.295626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34211739-634f-4c47-96d4-1f59234836e9 None admin] RBAC: Authorizing `identity:get_project(project_id=b09410b07f4f4099bbb8186af3042b72)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:20.297031 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34211739-634f-4c47-96d4-1f59234836e9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:20.298963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 432/855] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:29:20 2022] GET /identity/v3/projects/b09410b07f4f4099bbb8186af3042b72 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:20.305453 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cee62a-a733-49ad-8322-ceafb3958d6f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:20.401557 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cee62a-a733-49ad-8322-ceafb3958d6f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:20.433598 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fca8a-8521-4e4e-a8d9-b6f50b6c4381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:20.434177 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fca8a-8521-4e4e-a8d9-b6f50b6c4381 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:20.434449 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fca8a-8521-4e4e-a8d9-b6f50b6c4381 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:20.434710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fca8a-8521-4e4e-a8d9-b6f50b6c4381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:20.435442 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fca8a-8521-4e4e-a8d9-b6f50b6c4381 None admin] RBAC: Adding query filter params (role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6, scope.project.id=b09410b07f4f4099bbb8186af3042b72, user.id=4791969dfc8b4498a55e31f6fac37d92) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:20.435744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fca8a-8521-4e4e-a8d9-b6f50b6c4381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:20.437148 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fca8a-8521-4e4e-a8d9-b6f50b6c4381 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:20.443197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 424/856] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:29:20 2022] GET /identity/v3/role_assignments?user.id=4791969dfc8b4498a55e31f6fac37d92&scope.project.id=b09410b07f4f4099bbb8186af3042b72&role.id=bfb1cb6dbfcf40ad9ba6b353b461eea6 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:22.572555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ab52-301d-4d5e-8df4-36db64551b42 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:22.573097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ab52-301d-4d5e-8df4-36db64551b42 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:22.573097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9ab52-301d-4d5e-8df4-36db64551b42 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:22.574393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 433/857] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:22.579481 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71728e-3460-4c24-905f-f08cfdeb715c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:22.580934 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71728e-3460-4c24-905f-f08cfdeb715c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:22.581212 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71728e-3460-4c24-905f-f08cfdeb715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:22.599133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2d71728e-3460-4c24-905f-f08cfdeb715c None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:22.600325 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2d71728e-3460-4c24-905f-f08cfdeb715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:22.643129 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:22.665160 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 425/858] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:22.933445 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9ab52-301d-4d5e-8df4-36db64551b42 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:23.023858 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:23.031458 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9ab52-301d-4d5e-8df4-36db64551b42 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:23.063959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a9aaa-d0a3-45c1-a4fd-08e636df4709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:23.064576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a9aaa-d0a3-45c1-a4fd-08e636df4709 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:23.065343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a9aaa-d0a3-45c1-a4fd-08e636df4709 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:23.065610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a9aaa-d0a3-45c1-a4fd-08e636df4709 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:23.066700 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a9aaa-d0a3-45c1-a4fd-08e636df4709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:23.068139 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a9aaa-d0a3-45c1-a4fd-08e636df4709 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:23.069673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 434/859] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:23.075455 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71728e-3460-4c24-905f-f08cfdeb715c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:23.170430 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71728e-3460-4c24-905f-f08cfdeb715c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:23.202829 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c098cb-0987-4258-b8da-f6b405816104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:23.203442 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c098cb-0987-4258-b8da-f6b405816104 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:23.203724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c098cb-0987-4258-b8da-f6b405816104 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:23.203995 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c098cb-0987-4258-b8da-f6b405816104 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:23.204638 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c098cb-0987-4258-b8da-f6b405816104 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:23.206726 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c098cb-0987-4258-b8da-f6b405816104 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:23.232434 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 426/860] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:29:23 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:29:25.376909 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc829-7a9e-4d99-833c-b5d6715de0e7 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:25.377497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc829-7a9e-4d99-833c-b5d6715de0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:25.377497 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fc829-7a9e-4d99-833c-b5d6715de0e7 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:25.379131 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 435/861] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:25.384309 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822e06-6798-42ee-8b4b-c4eadb98df90 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:25.384716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822e06-6798-42ee-8b4b-c4eadb98df90 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:25.384860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00822e06-6798-42ee-8b4b-c4eadb98df90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:25.402622 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-00822e06-6798-42ee-8b4b-c4eadb98df90 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:25.403819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-00822e06-6798-42ee-8b4b-c4eadb98df90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:25.427512 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:25.469447 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 427/862] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:25.739673 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fc829-7a9e-4d99-833c-b5d6715de0e7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:25.837355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fc829-7a9e-4d99-833c-b5d6715de0e7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:25.870840 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb1bde-3e4a-4524-9528-6aa1a560599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:25.871478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1bde-3e4a-4524-9528-6aa1a560599d None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:25.871754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1bde-3e4a-4524-9528-6aa1a560599d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:25.872021 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb1bde-3e4a-4524-9528-6aa1a560599d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:25.873111 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb1bde-3e4a-4524-9528-6aa1a560599d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:25.874517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb1bde-3e4a-4524-9528-6aa1a560599d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:25.876081 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 436/863] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:29:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:25.882263 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822e06-6798-42ee-8b4b-c4eadb98df90 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:25.979227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00822e06-6798-42ee-8b4b-c4eadb98df90 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:26.011440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f24cc2-e67e-4836-badb-f2d7324f8a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:26.011971 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f24cc2-e67e-4836-badb-f2d7324f8a18 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:26.012245 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f24cc2-e67e-4836-badb-f2d7324f8a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:26.012515 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f24cc2-e67e-4836-badb-f2d7324f8a18 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:26.013146 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f24cc2-e67e-4836-badb-f2d7324f8a18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:26.014552 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f24cc2-e67e-4836-badb-f2d7324f8a18 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:26.036197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 428/864] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:29:25 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:29:28.179554 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3385-4529-4283-b29e-96c3254c7308 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:28.180115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3385-4529-4283-b29e-96c3254c7308 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:28.180115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3385-4529-4283-b29e-96c3254c7308 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:28.181408 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 437/865] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:28.186647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7654f-d539-4906-b008-4aa27072d92f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:28.187055 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7654f-d539-4906-b008-4aa27072d92f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:28.187188 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7654f-d539-4906-b008-4aa27072d92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:28.205518 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fef7654f-d539-4906-b008-4aa27072d92f None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:28.206815 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fef7654f-d539-4906-b008-4aa27072d92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:28.216938 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:28.271214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 429/866] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:28.539596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd3385-4529-4283-b29e-96c3254c7308 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:28.569418 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:28.638818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd3385-4529-4283-b29e-96c3254c7308 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:28.671169 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431d19-6da2-4072-84f0-23052b5ca862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:28.671801 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431d19-6da2-4072-84f0-23052b5ca862 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:28.672077 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431d19-6da2-4072-84f0-23052b5ca862 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:28.672348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9431d19-6da2-4072-84f0-23052b5ca862 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:28.682610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9431d19-6da2-4072-84f0-23052b5ca862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-c9431d19-6da2-4072-84f0-23052b5ca862 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:29:28.687369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:28.688509 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:28.690093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 438/867] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:28.694439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7654f-d539-4906-b008-4aa27072d92f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:28.789371 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7654f-d539-4906-b008-4aa27072d92f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:28.821261 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:28.821873 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:28.822071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:28.822338 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:28.822988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:28.823310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:28.824673 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:28.833427 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 430/868] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:28.839279 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431d19-6da2-4072-84f0-23052b5ca862 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:28.927546 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:28.937001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9431d19-6da2-4072-84f0-23052b5ca862 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:28.970165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb0c06-0679-4c7a-9f42-e9dd3229a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:28.970798 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0c06-0679-4c7a-9f42-e9dd3229a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:28.972004 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0c06-0679-4c7a-9f42-e9dd3229a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:28.972272 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb0c06-0679-4c7a-9f42-e9dd3229a6bb None admin] PATH_INFO: `/v3/users/90adfdab61864ab9bf7998cf72160255` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:28.984563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb0c06-0679-4c7a-9f42-e9dd3229a6bb None admin] RBAC: Authorizing `identity:get_user(user_id=90adfdab61864ab9bf7998cf72160255)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:28.985965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb0c06-0679-4c7a-9f42-e9dd3229a6bb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:28.988082 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 439/869] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:28 2022] GET /identity/v3/users/90adfdab61864ab9bf7998cf72160255 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:28.993879 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:29.005626 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:29.092161 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6689ef-a1b7-4213-a373-b9d083d6066e None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:29.123928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8963df-c425-44bb-8b99-2cae14988098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:29.124547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8963df-c425-44bb-8b99-2cae14988098 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:29.124823 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8963df-c425-44bb-8b99-2cae14988098 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:29.125093 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8963df-c425-44bb-8b99-2cae14988098 None admin] PATH_INFO: `/v3/projects/0a1e59865d514ca78176f8e730e9b499` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:29.126181 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8963df-c425-44bb-8b99-2cae14988098 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1e59865d514ca78176f8e730e9b499)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:29.128522 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8963df-c425-44bb-8b99-2cae14988098 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:29.130114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 431/870] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:29:28 2022] GET /identity/v3/projects/0a1e59865d514ca78176f8e730e9b499 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:29.135916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb0c06-0679-4c7a-9f42-e9dd3229a6bb None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:29.230356 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb0c06-0679-4c7a-9f42-e9dd3229a6bb None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:29.263191 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c50ac-b48d-4261-b900-50364e471731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:29.263852 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c50ac-b48d-4261-b900-50364e471731 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:29.264128 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c50ac-b48d-4261-b900-50364e471731 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:29.264399 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c50ac-b48d-4261-b900-50364e471731 None admin] PATH_INFO: `/v3/projects/0a1e59865d514ca78176f8e730e9b499/users/90adfdab61864ab9bf7998cf72160255/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:29.266269 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c50ac-b48d-4261-b900-50364e471731 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a1e59865d514ca78176f8e730e9b499, user_id=90adfdab61864ab9bf7998cf72160255, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:29.268267 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c50ac-b48d-4261-b900-50364e471731 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:29.280303 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 440/871] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:29:29 2022] PUT /identity/v3/projects/0a1e59865d514ca78176f8e730e9b499/users/90adfdab61864ab9bf7998cf72160255/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:29:31.378821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b799ec-95c6-4fa3-b422-1d1d54031b18 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:31.379378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b799ec-95c6-4fa3-b422-1d1d54031b18 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:31.379378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b799ec-95c6-4fa3-b422-1d1d54031b18 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:31.380751 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 432/872] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:31.385967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d1e1-fd71-4d38-9b3a-17bebdab9f51 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:31.386374 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d1e1-fd71-4d38-9b3a-17bebdab9f51 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:31.386503 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d1e1-fd71-4d38-9b3a-17bebdab9f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:31.404510 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-8b35d1e1-fd71-4d38-9b3a-17bebdab9f51 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:31.405662 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8b35d1e1-fd71-4d38-9b3a-17bebdab9f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:31.407569 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:31.472621 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 441/873] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:31.744070 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b799ec-95c6-4fa3-b422-1d1d54031b18 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:31.820620 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:31.844876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b799ec-95c6-4fa3-b422-1d1d54031b18 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:31.880331 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d3e89-fe66-42c4-bab5-5dfced4ee77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:31.880951 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d3e89-fe66-42c4-bab5-5dfced4ee77f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:31.881225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d3e89-fe66-42c4-bab5-5dfced4ee77f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:31.881493 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d3e89-fe66-42c4-bab5-5dfced4ee77f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:31.891193 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d3e89-fe66-42c4-bab5-5dfced4ee77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-496d3e89-fe66-42c4-bab5-5dfced4ee77f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:29:31.896027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:31.897204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:31.898317 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 433/874] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:31.903188 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35d1e1-fd71-4d38-9b3a-17bebdab9f51 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:31.997627 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35d1e1-fd71-4d38-9b3a-17bebdab9f51 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:32.030079 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:32.030663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:32.030939 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:32.031207 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:32.031876 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:32.032173 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:32.033721 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:32.038426 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:32.042036 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 442/875] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:32.047573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d3e89-fe66-42c4-bab5-5dfced4ee77f None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:32.144746 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d3e89-fe66-42c4-bab5-5dfced4ee77f None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:32.177744 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f92c1c-c448-4741-9981-54fe11d1f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:32.178350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f92c1c-c448-4741-9981-54fe11d1f106 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:32.178624 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f92c1c-c448-4741-9981-54fe11d1f106 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:32.178894 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f92c1c-c448-4741-9981-54fe11d1f106 None admin] PATH_INFO: `/v3/users/90adfdab61864ab9bf7998cf72160255` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:32.180025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f92c1c-c448-4741-9981-54fe11d1f106 None admin] RBAC: Authorizing `identity:get_user(user_id=90adfdab61864ab9bf7998cf72160255)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:32.181440 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f92c1c-c448-4741-9981-54fe11d1f106 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:32.182986 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 434/876] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:32 2022] GET /identity/v3/users/90adfdab61864ab9bf7998cf72160255 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:32.188648 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:32.285315 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70383-b40e-486a-a7c7-dff7f6ad4c36 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:32.316953 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a1498-d345-4e0b-8fab-3659c1c7af11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:32.317541 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1498-d345-4e0b-8fab-3659c1c7af11 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:32.317816 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1498-d345-4e0b-8fab-3659c1c7af11 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:32.318084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a1498-d345-4e0b-8fab-3659c1c7af11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:32.380610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:32.382790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a1498-d345-4e0b-8fab-3659c1c7af11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:32.384535 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a1498-d345-4e0b-8fab-3659c1c7af11 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:32.478061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 443/877] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:29:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:29:32.483932 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f92c1c-c448-4741-9981-54fe11d1f106 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:32.487785 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:32.579060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f92c1c-c448-4741-9981-54fe11d1f106 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:32.611620 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb28da-3881-402a-9747-0184260d76b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:32.612231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb28da-3881-402a-9747-0184260d76b6 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:32.612506 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb28da-3881-402a-9747-0184260d76b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:32.612776 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb28da-3881-402a-9747-0184260d76b6 None admin] PATH_INFO: `/v3/projects/0a1e59865d514ca78176f8e730e9b499` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:32.613880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb28da-3881-402a-9747-0184260d76b6 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1e59865d514ca78176f8e730e9b499)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:32.615316 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb28da-3881-402a-9747-0184260d76b6 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:32.616899 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 435/878] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:29:32 2022] GET /identity/v3/projects/0a1e59865d514ca78176f8e730e9b499 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:32.623007 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a1498-d345-4e0b-8fab-3659c1c7af11 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:32.715208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:32.718119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a1498-d345-4e0b-8fab-3659c1c7af11 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:32.751513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298ac5f-9a18-40b6-922c-6eff020dca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:32.752200 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ac5f-9a18-40b6-922c-6eff020dca7e None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:32.752738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ac5f-9a18-40b6-922c-6eff020dca7e None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:32.753009 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298ac5f-9a18-40b6-922c-6eff020dca7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:32.753713 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298ac5f-9a18-40b6-922c-6eff020dca7e None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=0a1e59865d514ca78176f8e730e9b499, user.id=90adfdab61864ab9bf7998cf72160255) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:32.754014 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298ac5f-9a18-40b6-922c-6eff020dca7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:32.755433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298ac5f-9a18-40b6-922c-6eff020dca7e None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:32.760965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 444/879] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:29:32 2022] GET /identity/v3/role_assignments?user.id=90adfdab61864ab9bf7998cf72160255&scope.project.id=0a1e59865d514ca78176f8e730e9b499&role.id=78ddf427bf274205867c7492aec1f590 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:34.925320 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9aeaf-849c-44b0-b7c0-529a102e1101 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:34.925868 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9aeaf-849c-44b0-b7c0-529a102e1101 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:34.925868 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9aeaf-849c-44b0-b7c0-529a102e1101 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:34.927189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 436/880] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:34.932445 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e5015-63e4-4497-99d4-da80dc265ff9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:34.932880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e5015-63e4-4497-99d4-da80dc265ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:34.932975 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e5015-63e4-4497-99d4-da80dc265ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:34.951075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a27e5015-63e4-4497-99d4-da80dc265ff9 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:34.952267 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a27e5015-63e4-4497-99d4-da80dc265ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:35.016339 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 445/881] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:35.285162 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9aeaf-849c-44b0-b7c0-529a102e1101 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:35.353184 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:35.384065 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9aeaf-849c-44b0-b7c0-529a102e1101 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:35.416602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62097300-c41a-4e2b-8b30-36f7ea2e532e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:35.417189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097300-c41a-4e2b-8b30-36f7ea2e532e None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:35.417464 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097300-c41a-4e2b-8b30-36f7ea2e532e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:35.417732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62097300-c41a-4e2b-8b30-36f7ea2e532e None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:35.418379 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097300-c41a-4e2b-8b30-36f7ea2e532e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:35.419758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62097300-c41a-4e2b-8b30-36f7ea2e532e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:35.435197 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 437/882] 10.222.0.18 () {60 vars in 1138 bytes} [Tue Oct 18 11:29:35 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:29:37.620197 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3bef8-9af6-49c9-85c9-90f18c44b39c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:37.620758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3bef8-9af6-49c9-85c9-90f18c44b39c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:37.620758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3bef8-9af6-49c9-85c9-90f18c44b39c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:37.622043 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 446/883] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:37.627586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d01ed-253d-4494-9d20-f264131db03d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:37.627973 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d01ed-253d-4494-9d20-f264131db03d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:37.628138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d01ed-253d-4494-9d20-f264131db03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:37.645747 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5a8d01ed-253d-4494-9d20-f264131db03d None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:37.646922 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5a8d01ed-253d-4494-9d20-f264131db03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:37.711596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 438/884] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:37.986848 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3bef8-9af6-49c9-85c9-90f18c44b39c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:38.077818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:38.086015 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3bef8-9af6-49c9-85c9-90f18c44b39c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:38.117557 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4b7c2-cbc0-46b6-929b-59d2997d18b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:38.118164 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b7c2-cbc0-46b6-929b-59d2997d18b6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:38.118436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b7c2-cbc0-46b6-929b-59d2997d18b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:38.118702 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b7c2-cbc0-46b6-929b-59d2997d18b6 None admin] PATH_INFO: `/v3/domains/d9bb9cb7cec04843aba4c808f4360807` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:38.129404 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b7c2-cbc0-46b6-929b-59d2997d18b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9bb9cb7cec04843aba4c808f4360807)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:38.130813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b7c2-cbc0-46b6-929b-59d2997d18b6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:38.132399 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 447/885] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Oct 18 11:29:37 2022] GET /identity/v3/domains/d9bb9cb7cec04843aba4c808f4360807 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:38.138186 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d01ed-253d-4494-9d20-f264131db03d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:38.196201 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:38.234626 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d01ed-253d-4494-9d20-f264131db03d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:38.267456 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c048950-6d29-4cf6-8142-5ecd08a709b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:38.267982 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048950-6d29-4cf6-8142-5ecd08a709b3 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:38.268258 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048950-6d29-4cf6-8142-5ecd08a709b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:38.268529 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048950-6d29-4cf6-8142-5ecd08a709b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:38.269176 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c048950-6d29-4cf6-8142-5ecd08a709b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:38.270586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c048950-6d29-4cf6-8142-5ecd08a709b3 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:38.296902 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 439/886] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:29:38 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:29:40.488162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb8eb-a0ca-45a3-a2ae-e1221c4f579b None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:40.488732 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb8eb-a0ca-45a3-a2ae-e1221c4f579b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:40.488732 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acb8eb-a0ca-45a3-a2ae-e1221c4f579b None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:40.490033 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 448/887] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:40.495108 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c8e42-f2c2-4b09-9d8c-e335f07a0dc5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:40.495542 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c8e42-f2c2-4b09-9d8c-e335f07a0dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:40.495691 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c8e42-f2c2-4b09-9d8c-e335f07a0dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:40.514831 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-1e3c8e42-f2c2-4b09-9d8c-e335f07a0dc5 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:40.516013 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1e3c8e42-f2c2-4b09-9d8c-e335f07a0dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:40.581256 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 440/888] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:40.857900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acb8eb-a0ca-45a3-a2ae-e1221c4f579b None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:40.958704 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acb8eb-a0ca-45a3-a2ae-e1221c4f579b None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:40.991265 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad836cbe-a7c0-4860-8b37-6c474126deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:40.991881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad836cbe-a7c0-4860-8b37-6c474126deeb None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:40.992158 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad836cbe-a7c0-4860-8b37-6c474126deeb None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:40.992430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad836cbe-a7c0-4860-8b37-6c474126deeb None admin] PATH_INFO: `/v3/domains/d9bb9cb7cec04843aba4c808f4360807` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:40.993528 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad836cbe-a7c0-4860-8b37-6c474126deeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9bb9cb7cec04843aba4c808f4360807)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:40.994944 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad836cbe-a7c0-4860-8b37-6c474126deeb None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:40.996542 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 449/889] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Oct 18 11:29:40 2022] GET /identity/v3/domains/d9bb9cb7cec04843aba4c808f4360807 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:41.003060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c8e42-f2c2-4b09-9d8c-e335f07a0dc5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:41.045793 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:41.100320 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c8e42-f2c2-4b09-9d8c-e335f07a0dc5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:41.134486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497bcbd-84b9-4709-9064-d4fc055e63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:41.135072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497bcbd-84b9-4709-9064-d4fc055e63f9 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:41.135378 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497bcbd-84b9-4709-9064-d4fc055e63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:41.135645 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497bcbd-84b9-4709-9064-d4fc055e63f9 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:41.136284 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497bcbd-84b9-4709-9064-d4fc055e63f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:41.137697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497bcbd-84b9-4709-9064-d4fc055e63f9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:41.158389 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 441/890] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:29:41 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:29:43.318309 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff255-3435-420f-8dc7-75211d2e142c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:43.318844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff255-3435-420f-8dc7-75211d2e142c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:43.318844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff255-3435-420f-8dc7-75211d2e142c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:43.320189 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 450/891] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:43.325241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb69e-71c9-4b59-b0a2-679863451551 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:43.325654 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb69e-71c9-4b59-b0a2-679863451551 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:43.325775 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fb69e-71c9-4b59-b0a2-679863451551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:43.343721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c46fb69e-71c9-4b59-b0a2-679863451551 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:43.344874 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c46fb69e-71c9-4b59-b0a2-679863451551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:43.410227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 442/892] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:43.677923 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ff255-3435-420f-8dc7-75211d2e142c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:43.701476 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:43.777084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ff255-3435-420f-8dc7-75211d2e142c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:43.809826 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13a5e0-db87-4ae1-b027-94c3b7d435ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:43.810435 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a5e0-db87-4ae1-b027-94c3b7d435ea None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:43.810717 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a5e0-db87-4ae1-b027-94c3b7d435ea None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:43.810986 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a5e0-db87-4ae1-b027-94c3b7d435ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:43.820753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13a5e0-db87-4ae1-b027-94c3b7d435ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-6b13a5e0-db87-4ae1-b027-94c3b7d435ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:29:43.825524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:43.826513 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:29:43.827929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 451/893] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:43.833232 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fb69e-71c9-4b59-b0a2-679863451551 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:43.863057 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:43.932607 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fb69e-71c9-4b59-b0a2-679863451551 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:43.965341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:43.965934 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:43.966212 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:43.966485 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:43.967144 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:43.967473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:43.968840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:43.977239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 443/894] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:43.983195 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13a5e0-db87-4ae1-b027-94c3b7d435ea None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:44.063428 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:44.082224 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13a5e0-db87-4ae1-b027-94c3b7d435ea None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:44.114511 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c7449-2751-4a1a-8d9e-026b7bb3d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:44.115121 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7449-2751-4a1a-8d9e-026b7bb3d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:44.115426 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7449-2751-4a1a-8d9e-026b7bb3d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:44.115696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7449-2751-4a1a-8d9e-026b7bb3d5c6 None admin] PATH_INFO: `/v3/users/04233bf36fd04e4ba7c2ec76e35cef05` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:44.128854 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c7449-2751-4a1a-8d9e-026b7bb3d5c6 None admin] RBAC: Authorizing `identity:get_user(user_id=04233bf36fd04e4ba7c2ec76e35cef05)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:44.130269 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c7449-2751-4a1a-8d9e-026b7bb3d5c6 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:44.131861 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 452/895] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:43 2022] GET /identity/v3/users/04233bf36fd04e4ba7c2ec76e35cef05 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:44.137596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:44.227025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:44.235579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733bdc0-c41c-4b53-9760-4020b8c6c02c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:44.269188 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41629a-78b6-4bfe-bb55-f39f9628bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:44.269803 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41629a-78b6-4bfe-bb55-f39f9628bfce None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:44.270081 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41629a-78b6-4bfe-bb55-f39f9628bfce None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:44.270353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41629a-78b6-4bfe-bb55-f39f9628bfce None admin] PATH_INFO: `/v3/projects/1715ad9d435b4eb09581c9d12000e671` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:44.271486 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41629a-78b6-4bfe-bb55-f39f9628bfce None admin] RBAC: Authorizing `identity:get_project(project_id=1715ad9d435b4eb09581c9d12000e671)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:44.272908 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41629a-78b6-4bfe-bb55-f39f9628bfce None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:44.274535 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 444/896] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:29:44 2022] GET /identity/v3/projects/1715ad9d435b4eb09581c9d12000e671 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:44.280409 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c7449-2751-4a1a-8d9e-026b7bb3d5c6 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:44.374820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c7449-2751-4a1a-8d9e-026b7bb3d5c6 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:44.408599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e079ff9-bd6c-4e73-a461-41c020450eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:44.409231 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e079ff9-bd6c-4e73-a461-41c020450eb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:44.409506 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e079ff9-bd6c-4e73-a461-41c020450eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:44.409776 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e079ff9-bd6c-4e73-a461-41c020450eb2 None admin] PATH_INFO: `/v3/projects/1715ad9d435b4eb09581c9d12000e671/users/04233bf36fd04e4ba7c2ec76e35cef05/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:44.411682 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e079ff9-bd6c-4e73-a461-41c020450eb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1715ad9d435b4eb09581c9d12000e671, user_id=04233bf36fd04e4ba7c2ec76e35cef05, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:44.413084 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e079ff9-bd6c-4e73-a461-41c020450eb2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:44.421499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:44.426816 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 453/897] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:29:44 2022] PUT /identity/v3/projects/1715ad9d435b4eb09581c9d12000e671/users/04233bf36fd04e4ba7c2ec76e35cef05/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:29:46.574533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ba2f-eae8-405c-be62-2b10c1a2d7f5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:46.575090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ba2f-eae8-405c-be62-2b10c1a2d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:46.575090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211ba2f-eae8-405c-be62-2b10c1a2d7f5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:46.576424 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 445/898] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:29:46.581866 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28434d95-f190-48e1-8a00-ddb6888f2784 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:46.582287 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28434d95-f190-48e1-8a00-ddb6888f2784 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:46.582412 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28434d95-f190-48e1-8a00-ddb6888f2784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:46.600720 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-28434d95-f190-48e1-8a00-ddb6888f2784 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:29:46.601885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-28434d95-f190-48e1-8a00-ddb6888f2784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:29:46.665857 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 454/899] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:29:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:29:46.936621 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211ba2f-eae8-405c-be62-2b10c1a2d7f5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:47.036569 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211ba2f-eae8-405c-be62-2b10c1a2d7f5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:47.069124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c0acc-5454-46fe-a71b-1f7bed6e623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:47.069730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0acc-5454-46fe-a71b-1f7bed6e623a None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:47.070004 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0acc-5454-46fe-a71b-1f7bed6e623a None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:47.070274 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c0acc-5454-46fe-a71b-1f7bed6e623a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:47.080805 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c0acc-5454-46fe-a71b-1f7bed6e623a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-9c9c0acc-5454-46fe-a71b-1f7bed6e623a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:29:47.085511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:29:47.086591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:29:47.087484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 446/900] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:29:47.092562 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28434d95-f190-48e1-8a00-ddb6888f2784 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:47.188103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28434d95-f190-48e1-8a00-ddb6888f2784 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:47.216225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:47.222993 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:47.223604 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:47.223879 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:47.224145 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:47.224790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:47.225083 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:47.226415 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:47.234087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 455/901] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:47.240475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c0acc-5454-46fe-a71b-1f7bed6e623a None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:47.262524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:47.338180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c0acc-5454-46fe-a71b-1f7bed6e623a None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:47.371945 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4415-cff3-4d27-b5f6-18d72d9f0c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:47.372556 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4415-cff3-4d27-b5f6-18d72d9f0c72 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:47.372832 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4415-cff3-4d27-b5f6-18d72d9f0c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:47.373101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4415-cff3-4d27-b5f6-18d72d9f0c72 None admin] PATH_INFO: `/v3/users/04233bf36fd04e4ba7c2ec76e35cef05` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:47.374207 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4415-cff3-4d27-b5f6-18d72d9f0c72 None admin] RBAC: Authorizing `identity:get_user(user_id=04233bf36fd04e4ba7c2ec76e35cef05)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:47.375664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4415-cff3-4d27-b5f6-18d72d9f0c72 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:47.377503 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 447/902] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Oct 18 11:29:47 2022] GET /identity/v3/users/04233bf36fd04e4ba7c2ec76e35cef05 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:47.383263 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:47.480230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605553f2-88c4-4e3e-b0e3-12c4d1132a5b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:47.513362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6734e-f9ec-475c-bce1-ac821ec498aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:47.513953 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6734e-f9ec-475c-bce1-ac821ec498aa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:47.514233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6734e-f9ec-475c-bce1-ac821ec498aa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:47.514504 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6734e-f9ec-475c-bce1-ac821ec498aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:47.569701 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:47.579759 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6734e-f9ec-475c-bce1-ac821ec498aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:47.581184 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6734e-f9ec-475c-bce1-ac821ec498aa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:47.675747 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 456/903] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:29:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:29:47.681626 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4415-cff3-4d27-b5f6-18d72d9f0c72 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:47.768530 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:47.780408 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4415-cff3-4d27-b5f6-18d72d9f0c72 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:47.812390 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6265aa-b2e1-44f5-b7e5-8a839ae04b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:47.813001 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6265aa-b2e1-44f5-b7e5-8a839ae04b75 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:47.813273 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6265aa-b2e1-44f5-b7e5-8a839ae04b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:47.814047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6265aa-b2e1-44f5-b7e5-8a839ae04b75 None admin] PATH_INFO: `/v3/projects/1715ad9d435b4eb09581c9d12000e671` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:47.815833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6265aa-b2e1-44f5-b7e5-8a839ae04b75 None admin] RBAC: Authorizing `identity:get_project(project_id=1715ad9d435b4eb09581c9d12000e671)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:47.817247 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6265aa-b2e1-44f5-b7e5-8a839ae04b75 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:47.818843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 448/904] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Oct 18 11:29:47 2022] GET /identity/v3/projects/1715ad9d435b4eb09581c9d12000e671 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:47.825109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6734e-f9ec-475c-bce1-ac821ec498aa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:29:47.920074 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:47.928855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6734e-f9ec-475c-bce1-ac821ec498aa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:29:47.961714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63a6a8-04c3-4fc3-a7fa-89fbadd52044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:29:47.962302 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a6a8-04c3-4fc3-a7fa-89fbadd52044 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:29:47.962574 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a6a8-04c3-4fc3-a7fa-89fbadd52044 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:29:47.962839 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a6a8-04c3-4fc3-a7fa-89fbadd52044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:29:47.963567 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63a6a8-04c3-4fc3-a7fa-89fbadd52044 None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=1715ad9d435b4eb09581c9d12000e671, user.id=04233bf36fd04e4ba7c2ec76e35cef05) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:29:47.963864 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63a6a8-04c3-4fc3-a7fa-89fbadd52044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:29:47.965251 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63a6a8-04c3-4fc3-a7fa-89fbadd52044 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:29:47.970787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 457/905] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:29:47 2022] GET /identity/v3/role_assignments?user.id=04233bf36fd04e4ba7c2ec76e35cef05&scope.project.id=1715ad9d435b4eb09581c9d12000e671&role.id=78ddf427bf274205867c7492aec1f590 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:29:57.808350 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=22 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:29:57.968209 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=22 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:44.121114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a405f-7973-4d0e-b417-e745792b6cfd None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:44.121710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a405f-7973-4d0e-b417-e745792b6cfd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:44.121710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a405f-7973-4d0e-b417-e745792b6cfd None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:44.123079 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 449/906] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:30:44.129864 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fb261-995e-4257-a6b3-587bd4b7ee24 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:44.130312 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fb261-995e-4257-a6b3-587bd4b7ee24 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:44.130463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fb261-995e-4257-a6b3-587bd4b7ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:44.156859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e92fb261-995e-4257-a6b3-587bd4b7ee24 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:30:44.158041 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e92fb261-995e-4257-a6b3-587bd4b7ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:30:44.275288 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 458/907] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:30:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:30:44.570351 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a405f-7973-4d0e-b417-e745792b6cfd None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:44.767564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a405f-7973-4d0e-b417-e745792b6cfd None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:44.823480 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:44.824789 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:44.825063 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:44.825592 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:44.852305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:44.853936 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:30:44.881120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:44.882498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:30:44.883738 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:30:44.883738 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:44.883738 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:30:44.883738 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 450/908] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:44.887498 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fb261-995e-4257-a6b3-587bd4b7ee24 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:45.036515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fb261-995e-4257-a6b3-587bd4b7ee24 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:45.079769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:45.087226 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6082f-8022-498d-8e56-dd78c6f916e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:45.087863 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6082f-8022-498d-8e56-dd78c6f916e8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:45.088134 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6082f-8022-498d-8e56-dd78c6f916e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:45.088428 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6082f-8022-498d-8e56-dd78c6f916e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:45.089030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6082f-8022-498d-8e56-dd78c6f916e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:45.089323 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6082f-8022-498d-8e56-dd78c6f916e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:45.090672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6082f-8022-498d-8e56-dd78c6f916e8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:45.108926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 459/909] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:30:45.113890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:45.213095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:45.288204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776451ef-1ac3-49da-8f75-615767b7cd69 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:45.344469 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380ad92-cb1c-45f7-95bd-0fc7f530193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:45.345112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ad92-cb1c-45f7-95bd-0fc7f530193e None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:45.345436 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ad92-cb1c-45f7-95bd-0fc7f530193e None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:45.345695 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380ad92-cb1c-45f7-95bd-0fc7f530193e None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:45.346280 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380ad92-cb1c-45f7-95bd-0fc7f530193e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:45.347806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380ad92-cb1c-45f7-95bd-0fc7f530193e None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:45.376636 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 451/910] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Oct 18 11:30:45 2022] POST /identity/v3/users => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:30:47.938343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662fd9-2941-4a19-9f32-b3689e249b4f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:47.938343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662fd9-2941-4a19-9f32-b3689e249b4f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:47.938343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662fd9-2941-4a19-9f32-b3689e249b4f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:47.939602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 460/911] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:30:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:30:47.946138 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96648189-990f-4f40-bd40-e48f32c7f8b3 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:47.947072 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96648189-990f-4f40-bd40-e48f32c7f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:47.947590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96648189-990f-4f40-bd40-e48f32c7f8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:47.973068 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-96648189-990f-4f40-bd40-e48f32c7f8b3 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:30:47.974519 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-96648189-990f-4f40-bd40-e48f32c7f8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:30:48.079511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 452/912] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:30:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:30:48.382629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662fd9-2941-4a19-9f32-b3689e249b4f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:48.531959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662fd9-2941-4a19-9f32-b3689e249b4f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:48.574221 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3a3d4-6270-434b-bccc-bfd0ff033406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:48.574862 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a3d4-6270-434b-bccc-bfd0ff033406 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:48.575132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a3d4-6270-434b-bccc-bfd0ff033406 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:48.575471 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a3d4-6270-434b-bccc-bfd0ff033406 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:48.587522 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3a3d4-6270-434b-bccc-bfd0ff033406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-7bf3a3d4-6270-434b-bccc-bfd0ff033406 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:30:48.593640 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:48.594723 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:30:48.595915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 461/913] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:48.607315 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96648189-990f-4f40-bd40-e48f32c7f8b3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:48.662505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:48.745174 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96648189-990f-4f40-bd40-e48f32c7f8b3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:48.795881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:48.796596 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:48.796901 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:48.797171 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:48.797878 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] RBAC: Adding query filter params (name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:48.798155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:48.799659 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:48.809609 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 453/914] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:48.816424 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3a3d4-6270-434b-bccc-bfd0ff033406 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:48.891586 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:48.949966 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3a3d4-6270-434b-bccc-bfd0ff033406 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:48.991370 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:48.992004 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:48.992277 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:48.992539 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:49.004088 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:49.005441 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:30:49.023789 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:49.024790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:30:49.025724 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:30:49.025724 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:49.025724 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:30:49.025724 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 462/915] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:30:49.032809 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:49.167204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:49.175292 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511f15-912e-431c-a4f3-58e7d2d8036d None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:49.222475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:49.223174 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:49.223821 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:49.223951 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:49.224647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:49.224905 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:49.226572 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:49.249551 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 454/916] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:49.251916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:49.402555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1007752-aff7-4f86-8846-26ee00fdf01c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:49.406113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:49.453314 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:49.453952 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:49.454232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:49.454505 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:49.466389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:49.468540 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:30:49.481698 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:49.483449 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 11:30:49.484380 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:30:49.489155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:49.489629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 463/917] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:30:49.636570 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178cfa1-a074-4a29-9ae5-9f25ae6873cd None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:49.693724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:49.694321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:49.694606 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:49.694876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:49.695713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:49.696012 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:49.698186 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:49.724958 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 455/918] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 18 11:30:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:30:49.731000 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:49.859361 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af84ccf-dfca-4c73-a9dc-4cbb90c7f6d9 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:49.907502 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:49.908255 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:49.908686 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:49.908921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:49.920763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:49.922330 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:30:49.940769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:49.941790 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:30:49.944253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:30:49.944253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:49.944253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:30:49.944253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 464/919] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:49.948162 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:49.973121 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:50.072337 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aac9c4-dc48-4351-9264-c39a5e85c984 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:50.115850 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:50.116617 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:50.116975 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:50.117345 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:50.118283 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:50.118799 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:50.120465 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:50.135547 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 456/920] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:50.142556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:50.163581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:50.273657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd7bd-43d7-4037-b60d-57131d066752 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:50.318407 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:50.319071 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:50.319352 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:50.319651 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:50.326856 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:50.328337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:30:50.339959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:50.341023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:30:50.342750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 465/921] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:30:50.349281 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:50.457636 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:50.482048 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6a756-ae2b-4a56-b5a3-db45493e46d2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:50.521680 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c54baa-bcb4-4825-abb6-b6fd4a4b08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:50.522448 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54baa-bcb4-4825-abb6-b6fd4a4b08b0 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:50.522862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54baa-bcb4-4825-abb6-b6fd4a4b08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:50.523336 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c54baa-bcb4-4825-abb6-b6fd4a4b08b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:50.524110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c54baa-bcb4-4825-abb6-b6fd4a4b08b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:50.524504 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c54baa-bcb4-4825-abb6-b6fd4a4b08b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:50.526050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c54baa-bcb4-4825-abb6-b6fd4a4b08b0 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:50.549922 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 457/922] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:50.551626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:50.644849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:50.688363 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d783ce-db75-4c16-a3eb-3f69efc826fe None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:50.729005 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed9f56-cd38-48ba-918e-52a030c1fb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:50.729770 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed9f56-cd38-48ba-918e-52a030c1fb07 None admin] REQUEST_METHOD: `PUT` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:50.730148 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed9f56-cd38-48ba-918e-52a030c1fb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:50.730517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed9f56-cd38-48ba-918e-52a030c1fb07 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/e1aaf072ed724d8795f5994728152a3f/roles/2954c0a9ecde4a92a2e278db491ab7f9` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:50.752921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed9f56-cd38-48ba-918e-52a030c1fb07 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=e1aaf072ed724d8795f5994728152a3f, role_id=2954c0a9ecde4a92a2e278db491ab7f9)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:50.754354 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed9f56-cd38-48ba-918e-52a030c1fb07 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:50.771346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 466/923] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:30:50 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/e1aaf072ed724d8795f5994728152a3f/roles/2954c0a9ecde4a92a2e278db491ab7f9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:30:53.111927 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589e6d2-8ddf-4cb3-9945-ab807c7723ed None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:53.112400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589e6d2-8ddf-4cb3-9945-ab807c7723ed None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:53.112487 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589e6d2-8ddf-4cb3-9945-ab807c7723ed None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:53.113806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 458/924] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:30:53.120301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480e9e-4941-4e1a-aec5-fc85d9fa519c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:53.120911 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480e9e-4941-4e1a-aec5-fc85d9fa519c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:53.121333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480e9e-4941-4e1a-aec5-fc85d9fa519c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:53.152287 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-74480e9e-4941-4e1a-aec5-fc85d9fa519c None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:30:53.153829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-74480e9e-4941-4e1a-aec5-fc85d9fa519c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:30:53.240440 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 467/925] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:30:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:30:53.507412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589e6d2-8ddf-4cb3-9945-ab807c7723ed None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:53.628233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589e6d2-8ddf-4cb3-9945-ab807c7723ed None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:53.666304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fd280-d9af-4eed-b731-a7b3d2b54f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:53.667889 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fd280-d9af-4eed-b731-a7b3d2b54f66 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:53.668213 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fd280-d9af-4eed-b731-a7b3d2b54f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:53.668523 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fd280-d9af-4eed-b731-a7b3d2b54f66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:53.676332 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:53.680771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fd280-d9af-4eed-b731-a7b3d2b54f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-f59fd280-d9af-4eed-b731-a7b3d2b54f66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:30:53.687513 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:53.688473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:30:53.694433 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 459/926] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Oct 18 11:30:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:53.695150 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480e9e-4941-4e1a-aec5-fc85d9fa519c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:53.762074 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:53.820230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480e9e-4941-4e1a-aec5-fc85d9fa519c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:53.860477 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:53.861531 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:53.862028 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:53.862358 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:53.863069 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:53.863441 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:53.864921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:53.876816 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 468/927] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Oct 18 11:30:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:30:53.883114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fd280-d9af-4eed-b731-a7b3d2b54f66 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:53.991940 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fd280-d9af-4eed-b731-a7b3d2b54f66 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:54.033824 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:54.034375 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:54.034652 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:54.034920 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:54.045912 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:54.047398 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:30:54.061892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:54.062993 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:30:54.064169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:30:54.064169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:54.064169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:30:54.069321 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 460/928] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:54.069495 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:54.180912 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be501f0-7e30-496d-a76a-9a9f35f17b42 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:54.198785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:54.220976 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:54.221666 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:54.221971 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:54.222211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:54.222953 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:54.223276 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:54.224631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:54.244761 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 469/929] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:54.251963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:54.309001 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:54.372476 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff689f4-8b22-42a2-8eac-7535d1a2a3ff None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:54.414784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:54.415447 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:54.415764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:54.416048 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:54.425352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:54.426838 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:30:54.439152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:54.440463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:30:54.441719 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 461/930] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:54.446577 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:54.565034 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6d175-b24a-4755-8aa0-5b510889adb2 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:54.608296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:54.608996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:54.608996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:54.609205 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:54.610013 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:54.610316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:54.611872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:54.631022 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 470/931] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 18 11:30:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:54.637051 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:54.751168 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f823-0fd4-4bad-b42e-c27ee3b8cfe2 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:54.762348 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:54.788834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440af9f-7157-4399-a53f-1ecd56f42e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:54.789543 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440af9f-7157-4399-a53f-1ecd56f42e0b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:54.789831 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440af9f-7157-4399-a53f-1ecd56f42e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:54.790121 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440af9f-7157-4399-a53f-1ecd56f42e0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:54.867522 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440af9f-7157-4399-a53f-1ecd56f42e0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:54.869443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440af9f-7157-4399-a53f-1ecd56f42e0b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:54.981709 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 462/932] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:30:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 18 11:30:54.987691 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:55.022984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:55.093860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffecb-f581-4747-9f8d-e316a229036b None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:55.131874 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49584590-853e-4908-97fe-782590f92dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:55.132607 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584590-853e-4908-97fe-782590f92dac None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:55.132976 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584590-853e-4908-97fe-782590f92dac None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:55.133293 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584590-853e-4908-97fe-782590f92dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:55.145237 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49584590-853e-4908-97fe-782590f92dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:55.146932 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49584590-853e-4908-97fe-782590f92dac None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-49584590-853e-4908-97fe-782590f92dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:30:55.161199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:55.162322 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:30:55.163327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:30:55.163327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:55.163327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:30:55.163327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 471/933] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:30:55.170423 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440af9f-7157-4399-a53f-1ecd56f42e0b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:55.182640 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:55.276226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440af9f-7157-4399-a53f-1ecd56f42e0b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:55.315266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:55.315918 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:55.316238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:55.316465 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:55.317155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:55.317491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:55.319112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:55.331124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 463/934] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:55.337440 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49584590-853e-4908-97fe-782590f92dac None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:55.434267 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:55.452299 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49584590-853e-4908-97fe-782590f92dac None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:55.495441 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:55.496210 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:55.496566 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:55.496929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:55.508259 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:55.509990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:30:55.526626 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:55.527788 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:30:55.528818 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 472/935] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:30:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:30:55.535711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:55.620227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:55.656361 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1761e6-9f21-402c-95eb-f56eb37379d9 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:55.702767 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803412e-6ff3-469e-8963-01a09c825e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:55.703374 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803412e-6ff3-469e-8963-01a09c825e11 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:55.703655 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803412e-6ff3-469e-8963-01a09c825e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:55.703928 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803412e-6ff3-469e-8963-01a09c825e11 None admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:55.704586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803412e-6ff3-469e-8963-01a09c825e11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:55.704887 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803412e-6ff3-469e-8963-01a09c825e11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:55.706313 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803412e-6ff3-469e-8963-01a09c825e11 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:55.723354 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 464/936] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:30:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:55.726437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:55.839886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad7e8c-8d0f-4b63-835e-a32f11b06624 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:55.882898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086be85d-e9c0-41a1-8ade-1f540219c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:55.883581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be85d-e9c0-41a1-8ade-1f540219c57b None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:55.883859 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be85d-e9c0-41a1-8ade-1f540219c57b None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:55.884131 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086be85d-e9c0-41a1-8ade-1f540219c57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:55.884861 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086be85d-e9c0-41a1-8ade-1f540219c57b None admin] RBAC: Adding query filter params (role.id=2954c0a9ecde4a92a2e278db491ab7f9, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=e1aaf072ed724d8795f5994728152a3f) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:55.885162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086be85d-e9c0-41a1-8ade-1f540219c57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:55.886591 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086be85d-e9c0-41a1-8ade-1f540219c57b None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:55.893348 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 473/937] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:30:55 2022] GET /identity/v3/role_assignments?user.id=e1aaf072ed724d8795f5994728152a3f&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=2954c0a9ecde4a92a2e278db491ab7f9 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:30:58.179126 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b41a-eb10-4a58-9b9f-dc534219c89d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:58.179691 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b41a-eb10-4a58-9b9f-dc534219c89d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:58.179691 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b41a-eb10-4a58-9b9f-dc534219c89d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:58.181039 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 465/938] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:30:58.187209 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9099f-d497-42ed-a6cb-b70ae38e891e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:58.187657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9099f-d497-42ed-a6cb-b70ae38e891e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:58.187796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9099f-d497-42ed-a6cb-b70ae38e891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:58.206620 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-a8a9099f-d497-42ed-a6cb-b70ae38e891e None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:30:58.207929 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a8a9099f-d497-42ed-a6cb-b70ae38e891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:30:58.210957 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:58.290005 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 474/939] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:30:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:30:58.572551 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96b41a-eb10-4a58-9b9f-dc534219c89d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:58.685892 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96b41a-eb10-4a58-9b9f-dc534219c89d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:58.715312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:58.722550 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d7031-7e7d-4b11-8ebb-46b247a20785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:58.723177 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d7031-7e7d-4b11-8ebb-46b247a20785 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:58.723481 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d7031-7e7d-4b11-8ebb-46b247a20785 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:58.723752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d7031-7e7d-4b11-8ebb-46b247a20785 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:58.735502 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d7031-7e7d-4b11-8ebb-46b247a20785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-766d7031-7e7d-4b11-8ebb-46b247a20785 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:30:58.740811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:58.742061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:30:58.742961 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 466/940] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:30:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:58.748719 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9099f-d497-42ed-a6cb-b70ae38e891e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:58.865755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9099f-d497-42ed-a6cb-b70ae38e891e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:58.903989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:58.904661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:58.904941 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:58.905216 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:58.906165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:58.906514 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:58.908057 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:58.918900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 475/941] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:30:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:58.925966 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d7031-7e7d-4b11-8ebb-46b247a20785 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:59.036341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d7031-7e7d-4b11-8ebb-46b247a20785 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:59.071785 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:59.072413 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:59.072687 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:59.072962 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:59.084560 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:59.085932 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:30:59.100947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:59.102150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:30:59.103276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:30:59.103276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:59.103276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:30:59.103276 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 467/942] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:59.108962 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:59.119019 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:59.224347 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871e78e-6022-465b-bb99-b0c79780da70 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:59.261514 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:59.262119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:59.262440 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:59.262658 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:59.263423 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:59.263720 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:59.265252 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:59.277753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 476/943] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 18 11:30:59.284581 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:59.332219 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:59.397760 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938dda4-9ce1-40e5-9477-c98f961fc8c4 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:59.432685 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:59.433318 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:59.433583 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:59.433860 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:59.442005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:59.443481 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:30:59.455373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:59.456602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:30:59.457924 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 468/944] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:59.462447 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:59.536822 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:59.587223 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29df31-debc-48b7-97e1-c8274666c702 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:59.625756 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:59.626580 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:59.626900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:59.627201 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:59.628108 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:30:59.628456 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:59.630026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:59.649942 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 477/945] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 18 11:30:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:30:59.657523 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:59.769988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109357-b0e9-40c6-b0ea-9a368273fbc5 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:59.771524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:30:59.807200 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:30:59.808063 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:30:59.808429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:30:59.811226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:30:59.820574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:30:59.822052 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:30:59.838490 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:30:59.839834 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:30:59.840917 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:30:59.840917 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:30:59.840917 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:30:59.840917 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 469/946] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:30:59.845725 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:30:59.961918 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2e1ba-09db-44b0-a5e6-40f068e33688 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:30:59.986340 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:00.003849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:00.004486 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:00.004834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:00.005202 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:00.005963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:00.006398 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:00.008038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:00.022252 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 478/947] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:00.028269 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:00.142629 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90ee9e-2016-4630-88c7-03b21050cc1c None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:00.179356 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:00.179978 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:00.180248 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:00.180607 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:00.187906 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:00.189487 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:31:00.202837 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:00.203771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:31:00.204715 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 470/948] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:31:00.210152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:00.328253 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e292aae-e7da-4998-a211-0f18be48e0fa None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:00.366250 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c3ef-03ab-4bb3-9e08-b29bc007162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:00.366983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c3ef-03ab-4bb3-9e08-b29bc007162c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:00.367389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c3ef-03ab-4bb3-9e08-b29bc007162c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:00.367737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c3ef-03ab-4bb3-9e08-b29bc007162c None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:00.368575 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c3ef-03ab-4bb3-9e08-b29bc007162c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:00.368980 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c3ef-03ab-4bb3-9e08-b29bc007162c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:00.370665 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c3ef-03ab-4bb3-9e08-b29bc007162c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:00.384690 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 479/949] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:00.391484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:00.408590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:00.499233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b4a26-c294-4eed-b337-fb791895d254 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:00.535699 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e9c5e-0025-4cb0-94d8-fa3cc3a4b9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:00.536455 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9c5e-0025-4cb0-94d8-fa3cc3a4b9f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:00.536615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9c5e-0025-4cb0-94d8-fa3cc3a4b9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:00.536881 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9c5e-0025-4cb0-94d8-fa3cc3a4b9f7 None admin] PATH_INFO: `/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/e1aaf072ed724d8795f5994728152a3f/roles/78ddf427bf274205867c7492aec1f590` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:00.538880 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e9c5e-0025-4cb0-94d8-fa3cc3a4b9f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b526bee144da4b9cbb2deb3d6518b4f9, user_id=e1aaf072ed724d8795f5994728152a3f, role_id=78ddf427bf274205867c7492aec1f590)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:00.540344 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e9c5e-0025-4cb0-94d8-fa3cc3a4b9f7 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:00.555450 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 471/950] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Oct 18 11:31:00 2022] PUT /identity/v3/projects/b526bee144da4b9cbb2deb3d6518b4f9/users/e1aaf072ed724d8795f5994728152a3f/roles/78ddf427bf274205867c7492aec1f590 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 18 11:31:02.719865 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032cb5-0541-48be-bbbf-326dd076e205 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:02.720432 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032cb5-0541-48be-bbbf-326dd076e205 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:02.720432 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032cb5-0541-48be-bbbf-326dd076e205 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:02.721949 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 480/951] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:31:02.729044 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2b95-d257-46ca-8c4b-81550a73ba34 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:02.729565 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2b95-d257-46ca-8c4b-81550a73ba34 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:02.729671 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd2b95-d257-46ca-8c4b-81550a73ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:02.751166 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c9cd2b95-d257-46ca-8c4b-81550a73ba34 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:31:02.752705 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c9cd2b95-d257-46ca-8c4b-81550a73ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:31:02.828152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 472/952] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:31:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:31:03.115400 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2032cb5-0541-48be-bbbf-326dd076e205 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:03.165473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:03.239201 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2032cb5-0541-48be-bbbf-326dd076e205 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:03.277469 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004586f-8ec5-40e3-89da-1af16cda68c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:03.278094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004586f-8ec5-40e3-89da-1af16cda68c1 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:03.278521 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004586f-8ec5-40e3-89da-1af16cda68c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:03.278971 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004586f-8ec5-40e3-89da-1af16cda68c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:03.290274 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004586f-8ec5-40e3-89da-1af16cda68c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-4004586f-8ec5-40e3-89da-1af16cda68c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 18 11:31:03.296149 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:03.297152 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:03.298006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 481/953] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Oct 18 11:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:31:03.303498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2b95-d257-46ca-8c4b-81550a73ba34 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:03.307356 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:03.423332 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd2b95-d257-46ca-8c4b-81550a73ba34 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:03.459760 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:03.460451 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:03.460727 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:03.460997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:03.461653 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:03.461949 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:03.463334 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:03.472090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 473/954] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Oct 18 11:31:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:03.477919 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004586f-8ec5-40e3-89da-1af16cda68c1 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:03.594232 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:03.597315 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004586f-8ec5-40e3-89da-1af16cda68c1 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:03.639731 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:03.640426 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:03.640705 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:03.640978 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:03.652407 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:03.654918 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:31:03.673555 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:03.674602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:31:03.675547 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:31:03.675547 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:31:03.675547 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:03.675724 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 482/955] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:31:03.682894 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:03.756229 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:03.796806 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606ae6d-fb0c-42a3-a3ec-480221fdea7b None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:03.835538 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:03.836435 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:03.836761 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:03.836975 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] PATH_INFO: `/v3/domains` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:03.837760 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:03.838223 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:03.840074 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:03.855124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 474/956] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:03.861407 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:03.972527 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d919f7-1964-41f6-8d52-3663f5504000 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:04.008403 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:04.009030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:04.009307 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:04.009598 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:04.018870 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:04.020328 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 18 11:31:04.032144 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:04.033333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:04.034556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 483/957] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:31:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:31:04.039124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:04.150288 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef49c5-9147-4be4-b5a5-aab072d773ed None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:04.179657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:04.192721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:04.193407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:04.193713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:04.193986 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] PATH_INFO: `/v3/users` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:04.194766 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:04.195110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:04.196774 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:04.214149 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 475/958] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Oct 18 11:31:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:04.220225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:04.235563 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:04.330473 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2831c-9384-45be-8099-ff5374e43503 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:04.369199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fda77e-7640-4d9f-ad72-5b74e995fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:04.369864 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda77e-7640-4d9f-ad72-5b74e995fc46 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:04.370208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda77e-7640-4d9f-ad72-5b74e995fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:04.370490 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fda77e-7640-4d9f-ad72-5b74e995fc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:04.444663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fda77e-7640-4d9f-ad72-5b74e995fc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:04.446338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fda77e-7640-4d9f-ad72-5b74e995fc46 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:04.461644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:04.557398 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 484/959] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Oct 18 11:31:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 18 11:31:04.565409 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:04.672964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d7b9-0c04-4a00-991c-ea4776f43efb None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:04.708916 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:04.709720 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:04.710025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:04.710370 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:04.722101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:04.723579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 18 11:31:04.738439 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:04.739660 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 18 11:31:04.740706 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 18 11:31:04.740706 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 18 11:31:04.740706 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:31:04.740706 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 476/960] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:31:04.745423 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fda77e-7640-4d9f-ad72-5b74e995fc46 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:04.853393 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fda77e-7640-4d9f-ad72-5b74e995fc46 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:04.867901 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:04.892921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:04.894223 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:04.894223 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:04.894223 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:04.894663 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:04.894957 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:04.896325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:04.907740 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 485/961] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Oct 18 11:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:04.913470 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:04.957152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:05.030982 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3092e43-e58d-4162-b2ae-d31f4aad7c79 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:05.068092 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:05.068739 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:05.069017 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:05.069289 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:05.077098 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:05.078491 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 18 11:31:05.090611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:05.092308 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: ERROR keystone.server.flask.application Oct 18 11:31:05.093810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 477/962] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Oct 18 11:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 18 11:31:05.098373 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:05.206259 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a91b7-856d-40d2-8986-577ab2948fed None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:05.240967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4810a2-d4fd-466a-96b2-bb0aa1e129f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:05.241581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4810a2-d4fd-466a-96b2-bb0aa1e129f5 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:05.241857 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4810a2-d4fd-466a-96b2-bb0aa1e129f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:05.242129 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4810a2-d4fd-466a-96b2-bb0aa1e129f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:05.242819 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4810a2-d4fd-466a-96b2-bb0aa1e129f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:05.243120 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4810a2-d4fd-466a-96b2-bb0aa1e129f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:05.244589 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4810a2-d4fd-466a-96b2-bb0aa1e129f5 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:05.258769 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 486/963] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Oct 18 11:31:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:05.265505 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:05.364495 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:05.371366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556990-e740-4fd1-a66b-08930861e4af None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:05.416981 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576944eb-d59a-47cd-a084-a8a98b74e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:05.417571 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576944eb-d59a-47cd-a084-a8a98b74e77f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:05.417853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576944eb-d59a-47cd-a084-a8a98b74e77f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:05.418116 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576944eb-d59a-47cd-a084-a8a98b74e77f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:05.418853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576944eb-d59a-47cd-a084-a8a98b74e77f None admin] RBAC: Adding query filter params (role.id=78ddf427bf274205867c7492aec1f590, scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9, user.id=e1aaf072ed724d8795f5994728152a3f) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:05.419768 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576944eb-d59a-47cd-a084-a8a98b74e77f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:05.421189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576944eb-d59a-47cd-a084-a8a98b74e77f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:05.426846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 478/964] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Oct 18 11:31:05 2022] GET /identity/v3/role_assignments?user.id=e1aaf072ed724d8795f5994728152a3f&scope.project.id=b526bee144da4b9cbb2deb3d6518b4f9&role.id=78ddf427bf274205867c7492aec1f590 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:07.641706 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760d21-1ab5-4251-81ff-2acb1c563383 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:07.642286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760d21-1ab5-4251-81ff-2acb1c563383 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:07.642286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6760d21-1ab5-4251-81ff-2acb1c563383 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:07.643797 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 487/965] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:31:07.649493 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0a7a-0984-406e-bb53-d5a325fef567 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:07.650010 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0a7a-0984-406e-bb53-d5a325fef567 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:07.650162 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0a7a-0984-406e-bb53-d5a325fef567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:07.670081 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8c2b0a7a-0984-406e-bb53-d5a325fef567 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:31:07.671284 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8c2b0a7a-0984-406e-bb53-d5a325fef567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:31:07.737020 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 479/966] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:31:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:31:08.007750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760d21-1ab5-4251-81ff-2acb1c563383 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:08.039641 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:08.108381 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6760d21-1ab5-4251-81ff-2acb1c563383 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:08.142199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:08.142808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:08.143085 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:08.143381 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:08.143954 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:08.145301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:08.154094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:08.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:08.156599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 488/967] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 18 11:31:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:31:08.161178 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0a7a-0984-406e-bb53-d5a325fef567 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:08.250293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:08.260006 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0a7a-0984-406e-bb53-d5a325fef567 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:08.292563 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82755d70-505c-442b-8aa3-3c7b5652f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:08.293154 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755d70-505c-442b-8aa3-3c7b5652f2ca None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:08.293431 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755d70-505c-442b-8aa3-3c7b5652f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:08.293726 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82755d70-505c-442b-8aa3-3c7b5652f2ca None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:08.294343 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755d70-505c-442b-8aa3-3c7b5652f2ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:08.294641 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755d70-505c-442b-8aa3-3c7b5652f2ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:08.296023 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82755d70-505c-442b-8aa3-3c7b5652f2ca None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:08.300664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 480/968] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Oct 18 11:31:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:08.306515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:08.399400 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:08.405681 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf692a6-0084-4e62-83cf-ba0c483cd861 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:08.437365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8261c5-9420-4c8f-b070-578b2ff9874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:08.437951 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8261c5-9420-4c8f-b070-578b2ff9874a None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:08.438223 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8261c5-9420-4c8f-b070-578b2ff9874a None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:08.438490 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8261c5-9420-4c8f-b070-578b2ff9874a None admin] PATH_INFO: `/v3/services` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:08.439094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8261c5-9420-4c8f-b070-578b2ff9874a None admin] RBAC: Adding query filter params (type=placement) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:08.439419 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8261c5-9420-4c8f-b070-578b2ff9874a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:08.440751 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8261c5-9420-4c8f-b070-578b2ff9874a None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:08.445046 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 489/969] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Oct 18 11:31:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:10.586745 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855056-d50b-4da8-96ea-3a9f43c9ea42 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:10.587327 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855056-d50b-4da8-96ea-3a9f43c9ea42 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:10.587327 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855056-d50b-4da8-96ea-3a9f43c9ea42 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:10.588611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 481/970] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:31:10.594354 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead559e-b7da-4f95-8f54-cffac7040636 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:10.594737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead559e-b7da-4f95-8f54-cffac7040636 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:10.594886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead559e-b7da-4f95-8f54-cffac7040636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:10.613098 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4ead559e-b7da-4f95-8f54-cffac7040636 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:31:10.614248 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4ead559e-b7da-4f95-8f54-cffac7040636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:31:10.678153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 490/971] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:31:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 18 11:31:10.944104 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4855056-d50b-4da8-96ea-3a9f43c9ea42 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:11.041281 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4855056-d50b-4da8-96ea-3a9f43c9ea42 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:11.074279 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825da2f-6024-4636-96bf-2300c6d1c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:11.074911 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825da2f-6024-4636-96bf-2300c6d1c229 None admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:11.075185 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825da2f-6024-4636-96bf-2300c6d1c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:11.075476 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825da2f-6024-4636-96bf-2300c6d1c229 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:11.076112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825da2f-6024-4636-96bf-2300c6d1c229 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:11.077471 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825da2f-6024-4636-96bf-2300c6d1c229 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:11.092526 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 482/972] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Oct 18 11:31:10 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:31:13.242606 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ea4a-5ff2-4a39-9e20-766f81e9542c None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:13.243168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ea4a-5ff2-4a39-9e20-766f81e9542c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:13.243168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ea4a-5ff2-4a39-9e20-766f81e9542c None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:13.244515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 491/973] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:31:13.249936 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fd56-e998-43e4-aa4e-b7cf0dd1947f None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:13.250355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fd56-e998-43e4-aa4e-b7cf0dd1947f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:13.250462 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2fd56-e998-43e4-aa4e-b7cf0dd1947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:13.268769 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e3a2fd56-e998-43e4-aa4e-b7cf0dd1947f None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:31:13.269919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e3a2fd56-e998-43e4-aa4e-b7cf0dd1947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:31:13.279643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:13.342474 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 483/974] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:31:13 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:31:13.633632 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5ea4a-5ff2-4a39-9e20-766f81e9542c None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:13.721886 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:13.732972 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5ea4a-5ff2-4a39-9e20-766f81e9542c None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:13.766056 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:13.766699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:13.766977 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:13.767275 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:13.767844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:13.769186 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:13.777792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:13.779006 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:13.779904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 492/975] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 18 11:31:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:31:13.784846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2fd56-e998-43e4-aa4e-b7cf0dd1947f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:13.882794 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2fd56-e998-43e4-aa4e-b7cf0dd1947f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:13.915831 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:13.916366 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:13.916643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:13.916913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:13.917532 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:13.917835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:13.919811 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:13.924799 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 484/976] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Oct 18 11:31:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:13.930773 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:14.028583 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c1427-d030-4962-a3b5-c43eedb50cb3 None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:14.062370 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d48159-c4e6-4201-a98d-6c2cf1d5f5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:14.062961 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48159-c4e6-4201-a98d-6c2cf1d5f5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:14.063237 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48159-c4e6-4201-a98d-6c2cf1d5f5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:14.063542 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d48159-c4e6-4201-a98d-6c2cf1d5f5e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:14.064224 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d48159-c4e6-4201-a98d-6c2cf1d5f5e8 None admin] RBAC: Adding query filter params (interface=public, service_id=1389f97468024f20a969f37512b64c1c, region_id=RegionOne) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:14.064529 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d48159-c4e6-4201-a98d-6c2cf1d5f5e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:14.065880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d48159-c4e6-4201-a98d-6c2cf1d5f5e8 None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:14.070699 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 493/977] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Oct 18 11:31:13 2022] GET /identity/v3/endpoints?service_id=1389f97468024f20a969f37512b64c1c&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:14.076373 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:14.080168 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:14.174464 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf227e7-885a-47e6-af65-a06841055122 None admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:14.206238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4b58b-9d83-4b43-b27e-d92d1e19b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:14.206827 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4b58b-9d83-4b43-b27e-d92d1e19b08f None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:14.207102 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4b58b-9d83-4b43-b27e-d92d1e19b08f None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:14.207405 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4b58b-9d83-4b43-b27e-d92d1e19b08f None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:14.208000 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4b58b-9d83-4b43-b27e-d92d1e19b08f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:14.209351 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4b58b-9d83-4b43-b27e-d92d1e19b08f None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:14.216647 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 485/978] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Oct 18 11:31:14 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:31:16.362524 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a6da2-4b8c-4ada-8102-d12ec556e550 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:16.363086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a6da2-4b8c-4ada-8102-d12ec556e550 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:16.363086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a6da2-4b8c-4ada-8102-d12ec556e550 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:16.364429 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 494/979] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:31:16.369669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb8ae-bb16-4883-a9ff-8d1eb779941a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:16.370089 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb8ae-bb16-4883-a9ff-8d1eb779941a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:16.370214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb8ae-bb16-4883-a9ff-8d1eb779941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:16.389628 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-25beb8ae-bb16-4883-a9ff-8d1eb779941a None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:31:16.390792 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-25beb8ae-bb16-4883-a9ff-8d1eb779941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:31:16.451789 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:16.457597 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 486/980] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:31:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 18 11:31:16.733771 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a6da2-4b8c-4ada-8102-d12ec556e550 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:16.752958 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:16.834417 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a6da2-4b8c-4ada-8102-d12ec556e550 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:16.868209 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:16.868817 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:16.869087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:16.869349 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:16.869908 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:16.871346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 18 11:31:16.880087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 18 11:31:16.881225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.get_or_create( Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application with Lock( Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self._enter() Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application return self.creator() Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application created_value = creator( Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: ERROR keystone.server.flask.application Oct 18 11:31:16.882239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 495/981] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Oct 18 11:31:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 18 11:31:16.887657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beb8ae-bb16-4883-a9ff-8d1eb779941a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:16.982855 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beb8ae-bb16-4883-a9ff-8d1eb779941a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:17.015830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6b91a-0ef9-4167-b052-73e59393d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:17.016357 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b91a-0ef9-4167-b052-73e59393d536 None admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:17.016631 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b91a-0ef9-4167-b052-73e59393d536 None admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:17.016898 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b91a-0ef9-4167-b052-73e59393d536 None admin] PATH_INFO: `/v3/services` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:17.017540 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b91a-0ef9-4167-b052-73e59393d536 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81702) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:31:17.017838 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b91a-0ef9-4167-b052-73e59393d536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:17.019184 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b91a-0ef9-4167-b052-73e59393d536 None admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:17.024157 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 487/982] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Oct 18 11:31:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:31:17.030829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:31:17.109583 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:17.127989 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8eb6c-d665-4ded-8c32-5a544b1b242c None admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:31:17.160143 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef86dc-3737-4ba8-affd-01499b40920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:31:17.160726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef86dc-3737-4ba8-affd-01499b40920d None admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:31:17.161002 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef86dc-3737-4ba8-affd-01499b40920d None admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:31:17.161273 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef86dc-3737-4ba8-affd-01499b40920d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:31:17.161916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef86dc-3737-4ba8-affd-01499b40920d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:31:17.163277 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef86dc-3737-4ba8-affd-01499b40920d None admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:31:17.181283 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 496/983] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:31:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:31:27.021643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=69 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:31:27.177137 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:21.444884 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c05c3-2d27-416d-a54b-be30a87ec4e1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:21.445329 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c05c3-2d27-416d-a54b-be30a87ec4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:21.445412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c05c3-2d27-416d-a54b-be30a87ec4e1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:21.446773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 488/984] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:21.452734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eef97-4db7-41e3-b03d-3411a1a4f311 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:21.453213 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eef97-4db7-41e3-b03d-3411a1a4f311 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:21.453397 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eef97-4db7-41e3-b03d-3411a1a4f311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:21.551822 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-dc4eef97-4db7-41e3-b03d-3411a1a4f311 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:21.553116 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-dc4eef97-4db7-41e3-b03d-3411a1a4f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:21.663336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 497/985] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:21.968517 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8dd9-d760-4292-9ca7-06b3325035c4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:21.969060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8dd9-d760-4292-9ca7-06b3325035c4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:21.969415 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8dd9-d760-4292-9ca7-06b3325035c4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:21.970910 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 489/986] 10.222.0.18 () {54 vars in 964 bytes} [Tue Oct 18 11:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:21.977556 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2e62-2143-4445-bcad-b388cde7e682 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:21.977844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2e62-2143-4445-bcad-b388cde7e682 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:21.978256 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2e62-2143-4445-bcad-b388cde7e682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:22.072850 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f22d2e62-2143-4445-bcad-b388cde7e682 None None] MFA Rules not processed for user `c2572ace3a9f4b929f38c8d74ee3faa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:22.074185 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f22d2e62-2143-4445-bcad-b388cde7e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:22.097590 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:22.160490 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 498/987] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Oct 18 11:32:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:22.170469 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a8dd9-d760-4292-9ca7-06b3325035c4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:22.172763 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-488a8dd9-d760-4292-9ca7-06b3325035c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:22.287890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a8dd9-d760-4292-9ca7-06b3325035c4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:22.373743 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a70624-aeec-4593-ab53-6e37b081081b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:22.374712 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a70624-aeec-4593-ab53-6e37b081081b service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:22.375327 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a70624-aeec-4593-ab53-6e37b081081b service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:22.375930 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a70624-aeec-4593-ab53-6e37b081081b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:22.377721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b6a70624-aeec-4593-ab53-6e37b081081b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:22.438674 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:22.507076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a70624-aeec-4593-ab53-6e37b081081b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:22.508705 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a70624-aeec-4593-ab53-6e37b081081b service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:22.534124 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 490/988] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:25.039043 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8d8a-2e38-44f6-ac0a-cbc5354e3efb None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:25.039535 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8d8a-2e38-44f6-ac0a-cbc5354e3efb None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:25.039635 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8d8a-2e38-44f6-ac0a-cbc5354e3efb None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:25.041749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 499/989] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:25.046852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c033b-8327-4e1e-af83-538b1d0d311d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:25.047240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c033b-8327-4e1e-af83-538b1d0d311d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:25.047460 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c033b-8327-4e1e-af83-538b1d0d311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:25.118131 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ba3c033b-8327-4e1e-af83-538b1d0d311d None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:25.119965 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ba3c033b-8327-4e1e-af83-538b1d0d311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:25.213979 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 491/990] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:25.508482 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c8d8a-2e38-44f6-ac0a-cbc5354e3efb None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:25.510342 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ba0c8d8a-2e38-44f6-ac0a-cbc5354e3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:25.612483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c8d8a-2e38-44f6-ac0a-cbc5354e3efb None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:25.682199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:25.684511 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186d531-7ece-49c6-b425-f5038391a943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:25.685335 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d531-7ece-49c6-b425-f5038391a943 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:25.685786 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d531-7ece-49c6-b425-f5038391a943 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:25.686099 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186d531-7ece-49c6-b425-f5038391a943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:25.687972 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2186d531-7ece-49c6-b425-f5038391a943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:25.794164 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186d531-7ece-49c6-b425-f5038391a943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:25.795518 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186d531-7ece-49c6-b425-f5038391a943 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:25.813455 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 500/991] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:28.267422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d467ac-bba6-45ff-ac4f-6ecbd359a233 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:28.267963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d467ac-bba6-45ff-ac4f-6ecbd359a233 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:28.267963 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d467ac-bba6-45ff-ac4f-6ecbd359a233 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:28.269305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 492/992] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:28.274584 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cecce0-74d9-47e1-b276-cb3b94073266 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:28.275551 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cecce0-74d9-47e1-b276-cb3b94073266 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:28.275657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cecce0-74d9-47e1-b276-cb3b94073266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:28.341855 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-04cecce0-74d9-47e1-b276-cb3b94073266 None None] MFA Rules not processed for user `27e48a27bdb640c69e8aa0884b8aaa0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:28.343061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-04cecce0-74d9-47e1-b276-cb3b94073266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:28.394340 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:28.439323 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 501/993] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:28.740714 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28eb1-0628-48c4-9d3c-bfd30e7fbaf6 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:28.740989 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28eb1-0628-48c4-9d3c-bfd30e7fbaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:28.741259 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28eb1-0628-48c4-9d3c-bfd30e7fbaf6 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:28.742587 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 493/994] 10.222.0.18 () {54 vars in 964 bytes} [Tue Oct 18 11:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:28.749621 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf3ef-3c40-4361-a81d-36ae79bce510 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:28.749904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf3ef-3c40-4361-a81d-36ae79bce510 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:28.750177 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcf3ef-3c40-4361-a81d-36ae79bce510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:28.825714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-88fcf3ef-3c40-4361-a81d-36ae79bce510 None None] MFA Rules not processed for user `c2572ace3a9f4b929f38c8d74ee3faa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:28.826934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-88fcf3ef-3c40-4361-a81d-36ae79bce510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:28.903453 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 502/995] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Oct 18 11:32:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:28.912442 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f28eb1-0628-48c4-9d3c-bfd30e7fbaf6 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:28.913919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-39f28eb1-0628-48c4-9d3c-bfd30e7fbaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:28.925076 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:29.016556 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f28eb1-0628-48c4-9d3c-bfd30e7fbaf6 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:29.089161 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54b983-ee83-4fe0-9c12-7c54870c6922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:29.089760 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54b983-ee83-4fe0-9c12-7c54870c6922 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:29.090036 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54b983-ee83-4fe0-9c12-7c54870c6922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:29.090304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54b983-ee83-4fe0-9c12-7c54870c6922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:29.091912 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6c54b983-ee83-4fe0-9c12-7c54870c6922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:29.152831 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:29.198770 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54b983-ee83-4fe0-9c12-7c54870c6922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:29.200220 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54b983-ee83-4fe0-9c12-7c54870c6922 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:29.219635 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 494/996] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:32.293517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d046-2f6f-4e04-8099-3d9b4081628f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:32.294086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d046-2f6f-4e04-8099-3d9b4081628f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:32.294086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d046-2f6f-4e04-8099-3d9b4081628f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:32.295430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 503/997] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:32.300688 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e8ca2-6cb2-4da5-9644-20525a01a347 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:32.301071 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e8ca2-6cb2-4da5-9644-20525a01a347 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:32.301225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e8ca2-6cb2-4da5-9644-20525a01a347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:32.365376 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-5a2e8ca2-6cb2-4da5-9644-20525a01a347 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:32.366550 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-5a2e8ca2-6cb2-4da5-9644-20525a01a347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:32.462257 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 495/998] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:32.746487 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d046-2f6f-4e04-8099-3d9b4081628f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:32.748102 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ca63d046-2f6f-4e04-8099-3d9b4081628f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:32.798958 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:32.861577 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d046-2f6f-4e04-8099-3d9b4081628f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:32.936499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f36a5-ccb8-4c5b-b894-f61f4a4caafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:32.937094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f36a5-ccb8-4c5b-b894-f61f4a4caafc service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:32.937370 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f36a5-ccb8-4c5b-b894-f61f4a4caafc service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:32.937633 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f36a5-ccb8-4c5b-b894-f61f4a4caafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:32.939190 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f34f36a5-ccb8-4c5b-b894-f61f4a4caafc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:33.032608 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:33.046576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f36a5-ccb8-4c5b-b894-f61f4a4caafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:33.048024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f36a5-ccb8-4c5b-b894-f61f4a4caafc service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:33.066086 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 504/999] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:35.916035 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3ccf0-8887-42f5-adee-420d0e56ba07 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:35.916562 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3ccf0-8887-42f5-adee-420d0e56ba07 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:35.916562 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3ccf0-8887-42f5-adee-420d0e56ba07 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:35.917919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 496/1000] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:35.923197 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82427ad-3f2c-4506-9ee8-656c04911ad3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:35.923605 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82427ad-3f2c-4506-9ee8-656c04911ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:35.923758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82427ad-3f2c-4506-9ee8-656c04911ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:35.999020 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b82427ad-3f2c-4506-9ee8-656c04911ad3 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:36.000306 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b82427ad-3f2c-4506-9ee8-656c04911ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:36.104133 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 505/1001] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:36.394987 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3ccf0-8887-42f5-adee-420d0e56ba07 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:36.396658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0cf3ccf0-8887-42f5-adee-420d0e56ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:36.417078 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:36.502757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3ccf0-8887-42f5-adee-420d0e56ba07 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:36.579431 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08607b2-957e-4577-a253-597805b12f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:36.580032 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08607b2-957e-4577-a253-597805b12f68 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:36.580303 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08607b2-957e-4577-a253-597805b12f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:36.580568 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08607b2-957e-4577-a253-597805b12f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:36.582132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c08607b2-957e-4577-a253-597805b12f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:36.654643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:36.692707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08607b2-957e-4577-a253-597805b12f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:36.694169 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08607b2-957e-4577-a253-597805b12f68 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:36.712488 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 497/1002] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:38.928872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0de4-b9b2-4bb6-a40e-dc2ca30d0a78 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:38.929437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0de4-b9b2-4bb6-a40e-dc2ca30d0a78 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:38.929437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0de4-b9b2-4bb6-a40e-dc2ca30d0a78 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:38.931360 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 506/1003] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:38.936876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727719a-5ca8-4533-99e7-a92c96709e7e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:38.937319 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727719a-5ca8-4533-99e7-a92c96709e7e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:38.937423 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727719a-5ca8-4533-99e7-a92c96709e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:39.007877 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-c727719a-5ca8-4533-99e7-a92c96709e7e None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:39.009765 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c727719a-5ca8-4533-99e7-a92c96709e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:39.110987 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 498/1004] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:39.396172 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0de4-b9b2-4bb6-a40e-dc2ca30d0a78 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:39.397666 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a07b0de4-b9b2-4bb6-a40e-dc2ca30d0a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:39.457912 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:39.501895 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0de4-b9b2-4bb6-a40e-dc2ca30d0a78 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:39.577294 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f364d-b568-4bba-8a8d-446807bd113b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:39.577904 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f364d-b568-4bba-8a8d-446807bd113b service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:39.578161 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f364d-b568-4bba-8a8d-446807bd113b service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:39.578420 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f364d-b568-4bba-8a8d-446807bd113b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:39.580038 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-783f364d-b568-4bba-8a8d-446807bd113b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:39.689668 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:39.691754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f364d-b568-4bba-8a8d-446807bd113b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:39.693799 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f364d-b568-4bba-8a8d-446807bd113b service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:39.712141 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 507/1005] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:41.958025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e970b-87f2-4d0d-9767-fa874e5ac3dc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:41.958534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e970b-87f2-4d0d-9767-fa874e5ac3dc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:41.958534 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e970b-87f2-4d0d-9767-fa874e5ac3dc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:41.959907 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 499/1006] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:41.965646 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8928f8-7033-4502-8286-699f964bb9e4 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:41.966065 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8928f8-7033-4502-8286-699f964bb9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:41.966192 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8928f8-7033-4502-8286-699f964bb9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:42.034142 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0e8928f8-7033-4502-8286-699f964bb9e4 None None] MFA Rules not processed for user `27e48a27bdb640c69e8aa0884b8aaa0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:42.035397 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0e8928f8-7033-4502-8286-699f964bb9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:42.135720 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 508/1007] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:42.426552 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e970b-87f2-4d0d-9767-fa874e5ac3dc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:42.428134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f39e970b-87f2-4d0d-9767-fa874e5ac3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:42.460598 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:42.542003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e970b-87f2-4d0d-9767-fa874e5ac3dc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:42.617410 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d94f31-d09d-49d6-ae14-61d28eca3661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:42.618533 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94f31-d09d-49d6-ae14-61d28eca3661 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:42.618805 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94f31-d09d-49d6-ae14-61d28eca3661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:42.619101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94f31-d09d-49d6-ae14-61d28eca3661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:42.620970 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a6d94f31-d09d-49d6-ae14-61d28eca3661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:42.700189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:42.732523 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94f31-d09d-49d6-ae14-61d28eca3661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:42.733876 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94f31-d09d-49d6-ae14-61d28eca3661 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:42.752190 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 500/1008] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:45.168059 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eff1c-133b-447a-937a-82f3fbcd8abf None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:45.168589 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eff1c-133b-447a-937a-82f3fbcd8abf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:45.168589 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eff1c-133b-447a-937a-82f3fbcd8abf None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:45.170028 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 509/1009] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:45.175297 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab0f6-a42e-46b0-ac04-67d0314b75bb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:45.175759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab0f6-a42e-46b0-ac04-67d0314b75bb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:45.176417 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ab0f6-a42e-46b0-ac04-67d0314b75bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:45.242560 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3f3ab0f6-a42e-46b0-ac04-67d0314b75bb None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:45.243865 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3f3ab0f6-a42e-46b0-ac04-67d0314b75bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:45.338645 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 501/1010] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:45.619243 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931eff1c-133b-447a-937a-82f3fbcd8abf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:45.621070 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-931eff1c-133b-447a-937a-82f3fbcd8abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:45.690737 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:45.724545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931eff1c-133b-447a-937a-82f3fbcd8abf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:45.796194 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82177f2a-4378-46f0-a331-f2d80f62dfc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:45.796782 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177f2a-4378-46f0-a331-f2d80f62dfc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:45.797052 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177f2a-4378-46f0-a331-f2d80f62dfc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:45.797315 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82177f2a-4378-46f0-a331-f2d80f62dfc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:45.798872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-82177f2a-4378-46f0-a331-f2d80f62dfc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:45.907933 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82177f2a-4378-46f0-a331-f2d80f62dfc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:45.909270 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82177f2a-4378-46f0-a331-f2d80f62dfc5 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:45.919738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:45.927933 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 510/1011] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 11:32:48.165568 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038e4a-2cfa-45ff-8e5c-d8637e2d7219 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:48.166110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038e4a-2cfa-45ff-8e5c-d8637e2d7219 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:48.166110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61038e4a-2cfa-45ff-8e5c-d8637e2d7219 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:48.167461 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 502/1012] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:48.172643 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a939fc-9288-4327-806e-22fd2b3926b8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:48.173075 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a939fc-9288-4327-806e-22fd2b3926b8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:48.173170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a939fc-9288-4327-806e-22fd2b3926b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:48.239279 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-30a939fc-9288-4327-806e-22fd2b3926b8 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:48.240494 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-30a939fc-9288-4327-806e-22fd2b3926b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:48.335140 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 511/1013] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:48.624222 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038e4a-2cfa-45ff-8e5c-d8637e2d7219 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:48.625753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-61038e4a-2cfa-45ff-8e5c-d8637e2d7219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:48.666050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:48.729183 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61038e4a-2cfa-45ff-8e5c-d8637e2d7219 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:48.802203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593919bb-68dd-4d8a-b1df-39a151600996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:48.802794 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593919bb-68dd-4d8a-b1df-39a151600996 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:48.803065 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593919bb-68dd-4d8a-b1df-39a151600996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:48.803355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593919bb-68dd-4d8a-b1df-39a151600996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:48.805487 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-593919bb-68dd-4d8a-b1df-39a151600996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:48.888772 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:48.914178 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593919bb-68dd-4d8a-b1df-39a151600996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:48.916406 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593919bb-68dd-4d8a-b1df-39a151600996 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:48.934658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 503/1014] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:51.420216 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ec657-1365-479f-a11c-973c254bdb07 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:51.420751 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ec657-1365-479f-a11c-973c254bdb07 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:51.420844 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ec657-1365-479f-a11c-973c254bdb07 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:51.422145 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 512/1015] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:51.427397 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cfcb-ced3-4b88-a425-c1bc9e5f0247 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:51.427778 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cfcb-ced3-4b88-a425-c1bc9e5f0247 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:51.427934 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cfcb-ced3-4b88-a425-c1bc9e5f0247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:51.496926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f837cfcb-ced3-4b88-a425-c1bc9e5f0247 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:51.498112 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f837cfcb-ced3-4b88-a425-c1bc9e5f0247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:51.595475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 504/1016] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:51.878726 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ec657-1365-479f-a11c-973c254bdb07 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:51.880266 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-427ec657-1365-479f-a11c-973c254bdb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:51.955107 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:51.984273 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ec657-1365-479f-a11c-973c254bdb07 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:52.057168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9cdea-e237-451a-b448-d43790b4697b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:52.057764 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9cdea-e237-451a-b448-d43790b4697b service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:52.058036 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9cdea-e237-451a-b448-d43790b4697b service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:52.058362 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9cdea-e237-451a-b448-d43790b4697b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:52.060026 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b2d9cdea-e237-451a-b448-d43790b4697b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:52.167520 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9cdea-e237-451a-b448-d43790b4697b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:52.168937 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9cdea-e237-451a-b448-d43790b4697b service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:52.186802 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 513/1017] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:56.240710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c640-e8e3-4048-8d03-e920142fbd1f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:56.241244 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c640-e8e3-4048-8d03-e920142fbd1f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:56.241244 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c640-e8e3-4048-8d03-e920142fbd1f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:56.243214 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 505/1018] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:56.248792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fe24d-d5b4-433b-9ae2-8a6eff38617c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:56.249202 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fe24d-d5b4-433b-9ae2-8a6eff38617c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:56.249336 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fe24d-d5b4-433b-9ae2-8a6eff38617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:56.254820 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:56.316514 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-357fe24d-d5b4-433b-9ae2-8a6eff38617c None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:56.317615 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-357fe24d-d5b4-433b-9ae2-8a6eff38617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:56.413542 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 514/1019] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:32:56.699640 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c640-e8e3-4048-8d03-e920142fbd1f None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:32:56.701221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d024c640-e8e3-4048-8d03-e920142fbd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:56.750511 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:56.808443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c640-e8e3-4048-8d03-e920142fbd1f None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:32:56.886941 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e68335-52e1-48f3-9e8d-faff6a49e0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:32:56.887568 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e68335-52e1-48f3-9e8d-faff6a49e0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:56.887843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e68335-52e1-48f3-9e8d-faff6a49e0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:56.888107 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e68335-52e1-48f3-9e8d-faff6a49e0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:56.889651 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-62e68335-52e1-48f3-9e8d-faff6a49e0a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:32:56.982113 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:32:56.999817 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e68335-52e1-48f3-9e8d-faff6a49e0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:32:57.001278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e68335-52e1-48f3-9e8d-faff6a49e0a6 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:32:57.019465 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 506/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:32:59.843059 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc3bd-5d06-4935-b23b-dade3972c9c9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:59.843617 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc3bd-5d06-4935-b23b-dade3972c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:59.843617 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dc3bd-5d06-4935-b23b-dade3972c9c9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:59.844957 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 515/1021] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:32:59.850053 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc415469-a10c-446c-93c8-82f7a3ae69b7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:32:59.850487 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc415469-a10c-446c-93c8-82f7a3ae69b7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:32:59.850588 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc415469-a10c-446c-93c8-82f7a3ae69b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:32:59.918615 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-cc415469-a10c-446c-93c8-82f7a3ae69b7 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:32:59.919845 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cc415469-a10c-446c-93c8-82f7a3ae69b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:00.018708 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 507/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:32:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:00.302896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc3bd-5d06-4935-b23b-dade3972c9c9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:00.305199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d24dc3bd-5d06-4935-b23b-dade3972c9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:00.399387 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:00.416813 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dc3bd-5d06-4935-b23b-dade3972c9c9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:00.488963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ba588-82b3-4263-a80a-fef8331a6922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:00.489559 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba588-82b3-4263-a80a-fef8331a6922 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:00.489850 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba588-82b3-4263-a80a-fef8331a6922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:00.490099 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba588-82b3-4263-a80a-fef8331a6922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:00.492501 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-543ba588-82b3-4263-a80a-fef8331a6922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:00.609695 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ba588-82b3-4263-a80a-fef8331a6922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:00.611111 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ba588-82b3-4263-a80a-fef8331a6922 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:00.629767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 516/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:04.775134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1936-d832-40db-a272-23a42d1433c4 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:04.775655 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1936-d832-40db-a272-23a42d1433c4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:04.775760 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f1936-d832-40db-a272-23a42d1433c4 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:04.777060 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 508/1024] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:04.782543 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084cfc1-918a-4188-a833-459b922120be None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:04.782960 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084cfc1-918a-4188-a833-459b922120be None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:04.783069 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084cfc1-918a-4188-a833-459b922120be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:04.799767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:04.856571 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1084cfc1-918a-4188-a833-459b922120be None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:04.857786 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1084cfc1-918a-4188-a833-459b922120be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:04.955400 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 517/1025] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:05.243777 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f1936-d832-40db-a272-23a42d1433c4 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:05.245680 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e30f1936-d832-40db-a272-23a42d1433c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:05.304590 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:05.349862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f1936-d832-40db-a272-23a42d1433c4 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:05.422472 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac98cf0-8a29-4e91-8548-113412f793d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:05.423064 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98cf0-8a29-4e91-8548-113412f793d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:05.423372 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98cf0-8a29-4e91-8548-113412f793d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:05.423642 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98cf0-8a29-4e91-8548-113412f793d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:05.425204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-aac98cf0-8a29-4e91-8548-113412f793d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:05.529175 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:05.533774 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac98cf0-8a29-4e91-8548-113412f793d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:05.535246 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac98cf0-8a29-4e91-8548-113412f793d4 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:05.553696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 509/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:10.584126 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f44ef-ddbd-4e61-a082-3c9e08d10356 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:10.584126 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f44ef-ddbd-4e61-a082-3c9e08d10356 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:10.584631 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f44ef-ddbd-4e61-a082-3c9e08d10356 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:10.587581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 518/1027] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 18 11:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:10.599376 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7b50-5e66-4806-ac50-19018456b396 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:10.599376 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7b50-5e66-4806-ac50-19018456b396 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:10.599376 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7b50-5e66-4806-ac50-19018456b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:10.696952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-01df7b50-5e66-4806-ac50-19018456b396 None None] MFA Rules not processed for user `e1aaf072ed724d8795f5994728152a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:10.698286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-01df7b50-5e66-4806-ac50-19018456b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:10.865250 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 510/1028] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 18 11:33:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:14.953760 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=59 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:15.169016 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b0f0-d4fc-4866-91a1-538273b20568 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:15.169381 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b0f0-d4fc-4866-91a1-538273b20568 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:15.169609 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b0f0-d4fc-4866-91a1-538273b20568 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:15.171048 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 519/1029] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 18 11:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:15.175930 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcef4c6-561e-4aa4-ab0d-84966f676889 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:15.176398 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcef4c6-561e-4aa4-ab0d-84966f676889 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:15.176722 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcef4c6-561e-4aa4-ab0d-84966f676889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:15.233406 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:15.259127 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6dcef4c6-561e-4aa4-ab0d-84966f676889 None None] MFA Rules not processed for user `e1aaf072ed724d8795f5994728152a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:15.260351 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6dcef4c6-561e-4aa4-ab0d-84966f676889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:15.381527 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 511/1030] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 18 11:33:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:16.619666 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840188cf-75a6-4f32-ac8b-cfad20b15875 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:16.620209 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840188cf-75a6-4f32-ac8b-cfad20b15875 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:16.620209 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840188cf-75a6-4f32-ac8b-cfad20b15875 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:16.621583 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 520/1031] 10.222.0.18 () {54 vars in 921 bytes} [Tue Oct 18 11:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:16.626579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d06fd-0f48-4a83-95df-bd19f8299946 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:16.627017 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d06fd-0f48-4a83-95df-bd19f8299946 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:16.627114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d06fd-0f48-4a83-95df-bd19f8299946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:16.703075 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-a69d06fd-0f48-4a83-95df-bd19f8299946 None None] MFA Rules not processed for user `e1aaf072ed724d8795f5994728152a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:16.704286 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a69d06fd-0f48-4a83-95df-bd19f8299946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:16.747326 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:16.814240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 512/1032] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Oct 18 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:20.422912 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f129-411a-44a7-b607-a180cab471bc None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:20.423935 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f129-411a-44a7-b607-a180cab471bc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:20.424448 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f129-411a-44a7-b607-a180cab471bc None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:20.430671 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 521/1033] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:20.432797 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94666deb-18ee-4de7-810c-60a6ca1eafc7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:20.433888 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94666deb-18ee-4de7-810c-60a6ca1eafc7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:20.434176 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94666deb-18ee-4de7-810c-60a6ca1eafc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:20.512801 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-94666deb-18ee-4de7-810c-60a6ca1eafc7 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:20.514222 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-94666deb-18ee-4de7-810c-60a6ca1eafc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:20.632945 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 513/1034] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:20.941096 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e24d-074a-4582-b21b-e4d0e0243acc None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:20.941382 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e24d-074a-4582-b21b-e4d0e0243acc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:20.941896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246e24d-074a-4582-b21b-e4d0e0243acc None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:20.945111 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 522/1035] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 18 11:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:20.962515 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5b60-b490-4409-bf79-618cf0afb8b7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:20.963153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5b60-b490-4409-bf79-618cf0afb8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:20.963587 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b5b60-b490-4409-bf79-618cf0afb8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:20.983813 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:21.056450 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4f1b5b60-b490-4409-bf79-618cf0afb8b7 None None] MFA Rules not processed for user `0a286777ff794c7a973a07881c195de1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:21.057840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4f1b5b60-b490-4409-bf79-618cf0afb8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:21.186866 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 514/1036] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 18 11:33:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 11:33:21.195061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e24d-074a-4582-b21b-e4d0e0243acc None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:21.196822 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b246e24d-074a-4582-b21b-e4d0e0243acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:21.355213 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246e24d-074a-4582-b21b-e4d0e0243acc None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:21.433768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:21.489135 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d62448-7e84-4952-97d1-c75abe1b5aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:21.489946 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62448-7e84-4952-97d1-c75abe1b5aab service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:21.490337 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62448-7e84-4952-97d1-c75abe1b5aab service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:21.495586 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d62448-7e84-4952-97d1-c75abe1b5aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:21.497618 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f9d62448-7e84-4952-97d1-c75abe1b5aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:21.601537 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d62448-7e84-4952-97d1-c75abe1b5aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:21.603132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d62448-7e84-4952-97d1-c75abe1b5aab service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:21.623686 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 523/1037] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:24.025604 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fe840-fcfe-49df-a337-b79ded3a196a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:24.026172 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fe840-fcfe-49df-a337-b79ded3a196a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:24.026172 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fe840-fcfe-49df-a337-b79ded3a196a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:24.030926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 515/1038] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:24.032829 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d59cc-df82-4897-8846-ca3d273c4e33 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:24.033667 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d59cc-df82-4897-8846-ca3d273c4e33 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:24.033667 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d59cc-df82-4897-8846-ca3d273c4e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:24.105795 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-482d59cc-df82-4897-8846-ca3d273c4e33 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:24.107119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-482d59cc-df82-4897-8846-ca3d273c4e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:24.146678 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:24.210463 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 524/1039] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:24.503444 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fe840-fcfe-49df-a337-b79ded3a196a None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:24.505183 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c20fe840-fcfe-49df-a337-b79ded3a196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:24.590453 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:24.692016 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fe840-fcfe-49df-a337-b79ded3a196a None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:24.817416 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbda92-b7df-40b9-86cd-fdd62d50d459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:24.818024 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbda92-b7df-40b9-86cd-fdd62d50d459 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:24.818886 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbda92-b7df-40b9-86cd-fdd62d50d459 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:24.819159 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbda92-b7df-40b9-86cd-fdd62d50d459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:24.820783 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f4dbda92-b7df-40b9-86cd-fdd62d50d459 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:24.844980 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:24.916903 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbda92-b7df-40b9-86cd-fdd62d50d459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:24.918507 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbda92-b7df-40b9-86cd-fdd62d50d459 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:24.938159 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 516/1040] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:27.451763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81aca-168b-4c7f-a356-ee51f4a0a4db None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:27.452304 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81aca-168b-4c7f-a356-ee51f4a0a4db None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:27.452304 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81aca-168b-4c7f-a356-ee51f4a0a4db None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:27.453545 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 525/1041] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:27.458894 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25ae3-4585-4566-aa4e-1d61fb02cdf5 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:27.459652 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25ae3-4585-4566-aa4e-1d61fb02cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:27.460103 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c25ae3-4585-4566-aa4e-1d61fb02cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:27.530040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-22c25ae3-4585-4566-aa4e-1d61fb02cdf5 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:27.531558 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-22c25ae3-4585-4566-aa4e-1d61fb02cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:27.634950 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:27.643579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 517/1042] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:27.931741 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd26f-f312-4178-8b42-8860af47bcdf None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:27.932105 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd26f-f312-4178-8b42-8860af47bcdf None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:27.932442 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd26f-f312-4178-8b42-8860af47bcdf None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:27.934085 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 526/1043] 10.222.0.18 () {54 vars in 961 bytes} [Tue Oct 18 11:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:27.939529 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613954d9-e00f-4f2b-abf8-de105753a6f7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:27.939810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613954d9-e00f-4f2b-abf8-de105753a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:27.940131 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613954d9-e00f-4f2b-abf8-de105753a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:28.022661 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-613954d9-e00f-4f2b-abf8-de105753a6f7 None None] MFA Rules not processed for user `0a286777ff794c7a973a07881c195de1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:28.024027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-613954d9-e00f-4f2b-abf8-de105753a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:28.150748 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 518/1044] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Oct 18 11:33:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:28.158576 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd26f-f312-4178-8b42-8860af47bcdf None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:28.160087 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3aedd26f-f312-4178-8b42-8860af47bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:28.316261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd26f-f312-4178-8b42-8860af47bcdf None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:28.338593 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:28.447707 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0780a4a-9604-472a-ac51-71d56cbd0689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:28.448677 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0780a4a-9604-472a-ac51-71d56cbd0689 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:28.449182 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0780a4a-9604-472a-ac51-71d56cbd0689 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:28.449678 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0780a4a-9604-472a-ac51-71d56cbd0689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:28.451733 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f0780a4a-9604-472a-ac51-71d56cbd0689 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:28.554871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0780a4a-9604-472a-ac51-71d56cbd0689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:28.556531 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0780a4a-9604-472a-ac51-71d56cbd0689 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:28.576282 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 527/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:28.598233 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413523e-497a-457a-b124-525761eebc9a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:28.598730 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413523e-497a-457a-b124-525761eebc9a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:28.598814 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413523e-497a-457a-b124-525761eebc9a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:28.600975 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 519/1046] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:28.606239 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0938-798b-4b2d-9643-2fca53f17b8a None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:28.606588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0938-798b-4b2d-9643-2fca53f17b8a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:28.606865 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0938-798b-4b2d-9643-2fca53f17b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:28.646175 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:28.695416 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-e29f0938-798b-4b2d-9643-2fca53f17b8a None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:28.695416 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e29f0938-798b-4b2d-9643-2fca53f17b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:28.813410 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 528/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:29.148922 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c0312-65d8-4d20-93d2-1b2ceab730bc None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:29.148922 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c0312-65d8-4d20-93d2-1b2ceab730bc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:29.148922 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c0312-65d8-4d20-93d2-1b2ceab730bc None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:29.150192 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 520/1048] 10.222.0.18 () {54 vars in 963 bytes} [Tue Oct 18 11:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:29.155433 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d64d6-adab-40f1-95c2-eb9a256ec061 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:29.155912 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d64d6-adab-40f1-95c2-eb9a256ec061 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:29.156184 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d64d6-adab-40f1-95c2-eb9a256ec061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:29.244226 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fb2d64d6-adab-40f1-95c2-eb9a256ec061 None None] MFA Rules not processed for user `676b9d7241084e86b41d982484363d24`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:29.245413 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fb2d64d6-adab-40f1-95c2-eb9a256ec061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:29.302255 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:29.338036 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 529/1049] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Oct 18 11:33:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:29.346314 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c0312-65d8-4d20-93d2-1b2ceab730bc None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:29.347929 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-049c0312-65d8-4d20-93d2-1b2ceab730bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:29.410931 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:29.472133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c0312-65d8-4d20-93d2-1b2ceab730bc None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:29.561152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058adc2f-9ac4-46d1-910c-c14f6c8e8806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '676b9d7241084e86b41d982484363d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:29.561770 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adc2f-9ac4-46d1-910c-c14f6c8e8806 service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:29.562043 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adc2f-9ac4-46d1-910c-c14f6c8e8806 service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:29.562312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058adc2f-9ac4-46d1-910c-c14f6c8e8806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:29.564050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-058adc2f-9ac4-46d1-910c-c14f6c8e8806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:29.676695 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:29.691400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058adc2f-9ac4-46d1-910c-c14f6c8e8806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:29.693741 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058adc2f-9ac4-46d1-910c-c14f6c8e8806 service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:29.715801 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 521/1050] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:30.847650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb421cb-8a0e-48f4-b39c-63940130c18f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:30.848156 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb421cb-8a0e-48f4-b39c-63940130c18f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:30.848270 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb421cb-8a0e-48f4-b39c-63940130c18f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:30.850282 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 530/1051] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:30.855307 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa04cf-94a0-4518-9137-f9337c003103 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:30.855705 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa04cf-94a0-4518-9137-f9337c003103 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:30.855840 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa04cf-94a0-4518-9137-f9337c003103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:30.922954 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-71fa04cf-94a0-4518-9137-f9337c003103 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:30.924198 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-71fa04cf-94a0-4518-9137-f9337c003103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:31.021405 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 522/1052] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:31.316221 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb421cb-8a0e-48f4-b39c-63940130c18f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:31.317840 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5bb421cb-8a0e-48f4-b39c-63940130c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:31.485963 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb421cb-8a0e-48f4-b39c-63940130c18f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:31.542684 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:31.609165 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8ccbe-b717-432a-851d-95391c2eb47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:31.609772 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8ccbe-b717-432a-851d-95391c2eb47b service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:31.610047 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8ccbe-b717-432a-851d-95391c2eb47b service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:31.610316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8ccbe-b717-432a-851d-95391c2eb47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:31.611915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-2fa8ccbe-b717-432a-851d-95391c2eb47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:31.705693 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8ccbe-b717-432a-851d-95391c2eb47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:31.707345 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8ccbe-b717-432a-851d-95391c2eb47b service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:31.726994 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 531/1053] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:33.985420 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb39ce-7708-4015-a907-0e02ea2eec6c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:33.985959 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb39ce-7708-4015-a907-0e02ea2eec6c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:33.985959 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb39ce-7708-4015-a907-0e02ea2eec6c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:33.987602 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 523/1054] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:33.993749 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531109e-7ce0-4f03-882c-f813d19505c3 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:33.994163 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531109e-7ce0-4f03-882c-f813d19505c3 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:33.994295 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531109e-7ce0-4f03-882c-f813d19505c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:34.066639 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b531109e-7ce0-4f03-882c-f813d19505c3 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:34.068080 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b531109e-7ce0-4f03-882c-f813d19505c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:34.076629 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:34.173933 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 532/1055] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:34.466971 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb39ce-7708-4015-a907-0e02ea2eec6c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:34.468489 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1fbb39ce-7708-4015-a907-0e02ea2eec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:34.533191 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:34.626429 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb39ce-7708-4015-a907-0e02ea2eec6c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:34.744805 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370580a-decd-4e2b-8bf2-3912c486508f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:34.745310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370580a-decd-4e2b-8bf2-3912c486508f service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:34.745583 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370580a-decd-4e2b-8bf2-3912c486508f service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:34.745846 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370580a-decd-4e2b-8bf2-3912c486508f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:34.747409 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6370580a-decd-4e2b-8bf2-3912c486508f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:34.767446 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:34.851127 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370580a-decd-4e2b-8bf2-3912c486508f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:34.853062 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370580a-decd-4e2b-8bf2-3912c486508f service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:34.874123 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 524/1056] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:37.107208 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98600-9d4f-46d5-a061-acb86a9123e2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:37.107719 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98600-9d4f-46d5-a061-acb86a9123e2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:37.107815 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d98600-9d4f-46d5-a061-acb86a9123e2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:37.109241 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 533/1057] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:37.114204 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5beb6-a2f0-43c5-bcb9-a407c13efb4e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:37.114643 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5beb6-a2f0-43c5-bcb9-a407c13efb4e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:37.115011 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5beb6-a2f0-43c5-bcb9-a407c13efb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:37.215030 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4ff5beb6-a2f0-43c5-bcb9-a407c13efb4e None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:37.217934 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4ff5beb6-a2f0-43c5-bcb9-a407c13efb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:37.333732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:37.340588 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 525/1058] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:37.637457 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d98600-9d4f-46d5-a061-acb86a9123e2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:37.639118 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c2d98600-9d4f-46d5-a061-acb86a9123e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:37.777834 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:37.789218 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d98600-9d4f-46d5-a061-acb86a9123e2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:37.910129 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4908ce-054e-4c4d-9a76-82e8c5267e9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:37.910586 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4908ce-054e-4c4d-9a76-82e8c5267e9b service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:37.910872 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4908ce-054e-4c4d-9a76-82e8c5267e9b service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:37.911137 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4908ce-054e-4c4d-9a76-82e8c5267e9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:37.912875 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-6a4908ce-054e-4c4d-9a76-82e8c5267e9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:38.012903 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4908ce-054e-4c4d-9a76-82e8c5267e9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:38.014468 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4908ce-054e-4c4d-9a76-82e8c5267e9b service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:38.026851 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:38.035718 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 534/1059] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:40.276092 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f16f-a3ea-4aa9-a759-e1bfca22a275 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:40.276664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f16f-a3ea-4aa9-a759-e1bfca22a275 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:40.276664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f16f-a3ea-4aa9-a759-e1bfca22a275 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:40.277968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 526/1060] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:40.283478 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40348559-e816-454b-92b6-d43653c7ed33 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:40.283892 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40348559-e816-454b-92b6-d43653c7ed33 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:40.284048 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40348559-e816-454b-92b6-d43653c7ed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:40.350965 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-40348559-e816-454b-92b6-d43653c7ed33 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:40.352311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-40348559-e816-454b-92b6-d43653c7ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:40.453768 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 535/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:40.744628 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4f16f-a3ea-4aa9-a759-e1bfca22a275 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:40.746134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-68f4f16f-a3ea-4aa9-a759-e1bfca22a275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:40.895389 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4f16f-a3ea-4aa9-a759-e1bfca22a275 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:40.970338 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:41.020166 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7a5d0-cc06-4be5-a6b0-6ac9e4e0e4d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:41.021383 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a5d0-cc06-4be5-a6b0-6ac9e4e0e4d2 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:41.021658 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a5d0-cc06-4be5-a6b0-6ac9e4e0e4d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:41.021925 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a5d0-cc06-4be5-a6b0-6ac9e4e0e4d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:41.023574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d8a7a5d0-cc06-4be5-a6b0-6ac9e4e0e4d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:41.116675 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7a5d0-cc06-4be5-a6b0-6ac9e4e0e4d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:41.118605 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7a5d0-cc06-4be5-a6b0-6ac9e4e0e4d2 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:41.137152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 527/1062] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:43.341625 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ed5d4-d77b-412b-88b3-69c3b5698433 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:43.342195 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ed5d4-d77b-412b-88b3-69c3b5698433 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:43.342195 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ed5d4-d77b-412b-88b3-69c3b5698433 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:43.343520 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 536/1063] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:43.349218 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d890b-c6b0-470f-bbf2-d347620b7d15 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:43.349640 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d890b-c6b0-470f-bbf2-d347620b7d15 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:43.349781 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d890b-c6b0-470f-bbf2-d347620b7d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:43.418997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-fb6d890b-c6b0-470f-bbf2-d347620b7d15 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:43.420257 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fb6d890b-c6b0-470f-bbf2-d347620b7d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:43.455153 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:43.521524 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 528/1064] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 11:33:43.820801 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ed5d4-d77b-412b-88b3-69c3b5698433 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:43.822363 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9c8ed5d4-d77b-412b-88b3-69c3b5698433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:43.902531 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:43.973206 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ed5d4-d77b-412b-88b3-69c3b5698433 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:44.098098 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fb067-80d4-4eb1-9616-1bdd50a11f9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:44.099378 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fb067-80d4-4eb1-9616-1bdd50a11f9e service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:44.099659 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fb067-80d4-4eb1-9616-1bdd50a11f9e service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:44.100005 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fb067-80d4-4eb1-9616-1bdd50a11f9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:44.101740 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-e28fb067-80d4-4eb1-9616-1bdd50a11f9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:44.146668 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:44.205778 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fb067-80d4-4eb1-9616-1bdd50a11f9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:44.208467 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fb067-80d4-4eb1-9616-1bdd50a11f9e service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:44.229808 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 537/1065] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 18 11:33:46.426978 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a616e-8691-4b51-aa29-938f82cddee5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:46.427711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a616e-8691-4b51-aa29-938f82cddee5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:46.427711 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a616e-8691-4b51-aa29-938f82cddee5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:46.429132 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 529/1066] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:46.434406 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988efd3-4593-4446-b515-ebe20f44eb20 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:46.435015 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988efd3-4593-4446-b515-ebe20f44eb20 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:46.435015 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988efd3-4593-4446-b515-ebe20f44eb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:46.501873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-0988efd3-4593-4446-b515-ebe20f44eb20 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:46.503136 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0988efd3-4593-4446-b515-ebe20f44eb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:46.609990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 538/1067] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:46.897999 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a616e-8691-4b51-aa29-938f82cddee5 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:46.899600 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-535a616e-8691-4b51-aa29-938f82cddee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:47.064003 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a616e-8691-4b51-aa29-938f82cddee5 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:47.080718 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:47.180667 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42fef3-2ee3-4214-904e-99b9ea020146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:47.181208 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fef3-2ee3-4214-904e-99b9ea020146 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:47.181498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fef3-2ee3-4214-904e-99b9ea020146 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:47.181779 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fef3-2ee3-4214-904e-99b9ea020146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:47.183451 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0c42fef3-2ee3-4214-904e-99b9ea020146 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:47.287742 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42fef3-2ee3-4214-904e-99b9ea020146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:47.289822 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42fef3-2ee3-4214-904e-99b9ea020146 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:47.313724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 530/1068] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:49.539311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bf660-97dc-4cea-819a-934fcfe4983f None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:49.539889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bf660-97dc-4cea-819a-934fcfe4983f None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:49.539889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bf660-97dc-4cea-819a-934fcfe4983f None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:49.541233 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 539/1069] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:49.546514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27bd34-486c-425a-9c0d-8955031dfc31 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:49.546944 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27bd34-486c-425a-9c0d-8955031dfc31 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:49.547062 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27bd34-486c-425a-9c0d-8955031dfc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:49.574029 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:49.615231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2b27bd34-486c-425a-9c0d-8955031dfc31 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:49.616452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2b27bd34-486c-425a-9c0d-8955031dfc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:49.715368 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 531/1070] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:50.005009 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bf660-97dc-4cea-819a-934fcfe4983f None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:50.006574 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a66bf660-97dc-4cea-819a-934fcfe4983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:50.020843 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:50.157346 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bf660-97dc-4cea-819a-934fcfe4983f None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:50.247977 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:50.250784 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3fec-de83-4e23-9d1f-69994a75df3f None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:50.251067 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3fec-de83-4e23-9d1f-69994a75df3f None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:50.251369 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d3fec-de83-4e23-9d1f-69994a75df3f None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:50.252705 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 532/1071] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:50.258696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29998-ec04-4bc3-bf69-6626f6a5b6d1 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:50.258972 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29998-ec04-4bc3-bf69-6626f6a5b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:50.259241 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29998-ec04-4bc3-bf69-6626f6a5b6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:50.275621 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b499a-03e4-4251-8761-503ac1ce9938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:50.276221 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b499a-03e4-4251-8761-503ac1ce9938 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:50.276491 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b499a-03e4-4251-8761-503ac1ce9938 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:50.276754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b499a-03e4-4251-8761-503ac1ce9938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:50.278325 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-be3b499a-03e4-4251-8761-503ac1ce9938 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:50.325893 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-edd29998-ec04-4bc3-bf69-6626f6a5b6d1 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:50.327081 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-edd29998-ec04-4bc3-bf69-6626f6a5b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:50.369472 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b499a-03e4-4251-8761-503ac1ce9938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:50.371147 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b499a-03e4-4251-8761-503ac1ce9938 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:50.378267 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:50.390588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 540/1072] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:50.428201 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 533/1073] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 11:33:50.737286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd7eb-1934-4320-9fbb-9175ac656594 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:50.737733 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd7eb-1934-4320-9fbb-9175ac656594 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:50.737898 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdd7eb-1934-4320-9fbb-9175ac656594 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:50.740316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 541/1074] 10.222.0.18 () {54 vars in 962 bytes} [Tue Oct 18 11:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:50.746128 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c2a96-c699-456f-bc2c-507e273a3f71 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:50.746584 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c2a96-c699-456f-bc2c-507e273a3f71 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:50.746669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c2a96-c699-456f-bc2c-507e273a3f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:50.825833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-b41c2a96-c699-456f-bc2c-507e273a3f71 None None] MFA Rules not processed for user `f7ca69834de848d1a3cbbeb63c6a0645`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:50.827012 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-b41c2a96-c699-456f-bc2c-507e273a3f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:50.907140 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 534/1075] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Oct 18 11:33:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:50.914505 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdd7eb-1934-4320-9fbb-9175ac656594 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:50.916044 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-abcdd7eb-1934-4320-9fbb-9175ac656594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:51.022331 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:51.023661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdd7eb-1934-4320-9fbb-9175ac656594 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:51.098798 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84114888-9b08-4b7d-a9a6-bfd9aa057e92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ca69834de848d1a3cbbeb63c6a0645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:51.099498 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84114888-9b08-4b7d-a9a6-bfd9aa057e92 service glance] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:51.099792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84114888-9b08-4b7d-a9a6-bfd9aa057e92 service glance] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:51.100065 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84114888-9b08-4b7d-a9a6-bfd9aa057e92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:51.101744 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-84114888-9b08-4b7d-a9a6-bfd9aa057e92 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:51.211950 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84114888-9b08-4b7d-a9a6-bfd9aa057e92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:51.213365 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84114888-9b08-4b7d-a9a6-bfd9aa057e92 service glance] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:51.231672 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 542/1076] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:51.994232 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b5a6-dd7b-4373-addd-37746c5339bc None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:51.994761 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b5a6-dd7b-4373-addd-37746c5339bc None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:51.994761 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39b5a6-dd7b-4373-addd-37746c5339bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:52.054591 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:52.065803 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-4a39b5a6-dd7b-4373-addd-37746c5339bc None None] MFA Rules not processed for user `c4de9bddab3c4a2e9fe8bb0f61123b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:52.067160 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-4a39b5a6-dd7b-4373-addd-37746c5339bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:52.152451 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 535/1077] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Oct 18 11:33:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:52.201262 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de225df-0aea-4afe-8a38-16aadb4a11c6 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:52.201738 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de225df-0aea-4afe-8a38-16aadb4a11c6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:52.201840 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de225df-0aea-4afe-8a38-16aadb4a11c6 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:52.203132 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 543/1078] 10.222.0.18 () {54 vars in 943 bytes} [Tue Oct 18 11:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:52.209483 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2437-de8c-4e99-9844-da327cd47a4b None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:52.209791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2437-de8c-4e99-9844-da327cd47a4b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:52.210050 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2437-de8c-4e99-9844-da327cd47a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:52.287099 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e7fb2437-de8c-4e99-9844-da327cd47a4b None None] MFA Rules not processed for user `ba0cf1bee1f5484992f924d93251a583`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:52.288230 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e7fb2437-de8c-4e99-9844-da327cd47a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:52.358150 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:52.395703 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 536/1079] 10.222.0.18 () {58 vars in 1040 bytes} [Tue Oct 18 11:33:52 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:52.404883 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de225df-0aea-4afe-8a38-16aadb4a11c6 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:52.406468 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8de225df-0aea-4afe-8a38-16aadb4a11c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:52.438997 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:52.549850 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de225df-0aea-4afe-8a38-16aadb4a11c6 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:52.597984 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef97a7-a9ed-438d-9b05-74ee58213fd5 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:52.598431 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef97a7-a9ed-438d-9b05-74ee58213fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:52.599084 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef97a7-a9ed-438d-9b05-74ee58213fd5 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:52.600830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 537/1080] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:33:52.605919 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab5a1-be73-47e7-91a0-7d10b276b847 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:52.606284 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab5a1-be73-47e7-91a0-7d10b276b847 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:52.606757 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab5a1-be73-47e7-91a0-7d10b276b847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:52.656492 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba0cf1bee1f5484992f924d93251a583', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:52.657097 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:52.657368 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:52.657636 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:52.659243 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:52.672462 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:52.677470 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-86bab5a1-be73-47e7-91a0-7d10b276b847 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:52.678669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-86bab5a1-be73-47e7-91a0-7d10b276b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:52.745925 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:52.747527 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:52.756398 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 544/1081] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Oct 18 11:33:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 18 11:33:52.777896 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 538/1082] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 18 11:33:53.081446 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:53.082967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:53.189622 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8708-d4e7-4c71-990e-b1d8ec4e9a97 service swift] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:53.266616 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:53.331158 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed89b9-fe3c-4d38-9800-0fa2fcaf3a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:53.331710 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed89b9-fe3c-4d38-9800-0fa2fcaf3a7c service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:53.331985 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed89b9-fe3c-4d38-9800-0fa2fcaf3a7c service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:53.332316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed89b9-fe3c-4d38-9800-0fa2fcaf3a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:53.333944 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-06ed89b9-fe3c-4d38-9800-0fa2fcaf3a7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:53.454153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed89b9-fe3c-4d38-9800-0fa2fcaf3a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:53.455777 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed89b9-fe3c-4d38-9800-0fa2fcaf3a7c service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:53.476975 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 545/1083] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:33:55.731739 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73652a3-cd90-4f1a-a80e-0cbd9b3b92fa None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:55.732823 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73652a3-cd90-4f1a-a80e-0cbd9b3b92fa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:55.733170 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73652a3-cd90-4f1a-a80e-0cbd9b3b92fa None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:55.734753 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 539/1084] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:33:55.741864 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb39c70-37da-4814-8393-b08f4d37dbcc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:55.742805 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb39c70-37da-4814-8393-b08f4d37dbcc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:55.743327 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb39c70-37da-4814-8393-b08f4d37dbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:55.841437 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-bfb39c70-37da-4814-8393-b08f4d37dbcc None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:33:55.842664 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bfb39c70-37da-4814-8393-b08f4d37dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:55.865215 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:55.951317 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 546/1085] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:33:56.246320 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73652a3-cd90-4f1a-a80e-0cbd9b3b92fa None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:33:56.247183 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a73652a3-cd90-4f1a-a80e-0cbd9b3b92fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:56.300951 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:56.417238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73652a3-cd90-4f1a-a80e-0cbd9b3b92fa None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:33:56.546700 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d3e1-3bf5-4780-a75a-4e95eac54c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:33:56.547215 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d3e1-3bf5-4780-a75a-4e95eac54c8d service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:33:56.547514 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d3e1-3bf5-4780-a75a-4e95eac54c8d service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:33:56.547781 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d3e1-3bf5-4780-a75a-4e95eac54c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:33:56.549357 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-dec2d3e1-3bf5-4780-a75a-4e95eac54c8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:33:56.560312 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:33:56.652407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d3e1-3bf5-4780-a75a-4e95eac54c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:33:56.654069 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d3e1-3bf5-4780-a75a-4e95eac54c8d service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:33:56.675520 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 540/1086] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:05.952115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=34 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:06.673203 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=41 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:15.778548 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce81b-7c14-4a0b-b9ec-7c6a2e6d9efd None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:15.779154 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce81b-7c14-4a0b-b9ec-7c6a2e6d9efd None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:15.779154 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630ce81b-7c14-4a0b-b9ec-7c6a2e6d9efd None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:15.780405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 547/1087] 10.222.0.18 () {54 vars in 918 bytes} [Tue Oct 18 11:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:15.785416 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009264c5-b80f-4dc7-8839-81a49851842e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:15.785852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009264c5-b80f-4dc7-8839-81a49851842e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:15.785958 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009264c5-b80f-4dc7-8839-81a49851842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:15.862458 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-009264c5-b80f-4dc7-8839-81a49851842e None None] MFA Rules not processed for user `e1aaf072ed724d8795f5994728152a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:15.865484 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-009264c5-b80f-4dc7-8839-81a49851842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:15.967678 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 541/1088] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Oct 18 11:34:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:15.982198 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc7f6-da7a-4ff3-9807-369c5b433bce None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:15.982479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc7f6-da7a-4ff3-9807-369c5b433bce None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:15.982753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bc7f6-da7a-4ff3-9807-369c5b433bce None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:15.984119 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 548/1089] 10.222.0.18 () {54 vars in 918 bytes} [Tue Oct 18 11:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:15.989133 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae9ec-6fbb-4e19-b1fc-6fb15a799b7e None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:15.989422 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae9ec-6fbb-4e19-b1fc-6fb15a799b7e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:15.989695 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae9ec-6fbb-4e19-b1fc-6fb15a799b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:16.062556 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:16.065669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-631ae9ec-6fbb-4e19-b1fc-6fb15a799b7e None None] MFA Rules not processed for user `0a286777ff794c7a973a07881c195de1`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:16.067435 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-631ae9ec-6fbb-4e19-b1fc-6fb15a799b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:16.178915 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 542/1090] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Oct 18 11:34:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:18.758755 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8f5ad-36bc-448e-b7c6-dd3d6f3eb927 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:18.759355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8f5ad-36bc-448e-b7c6-dd3d6f3eb927 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:18.759355 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8f5ad-36bc-448e-b7c6-dd3d6f3eb927 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:18.760638 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 549/1091] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:18.766194 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed210987-7dcf-4633-91a7-4d52fb51eecb None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:18.766622 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed210987-7dcf-4633-91a7-4d52fb51eecb None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:18.766717 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed210987-7dcf-4633-91a7-4d52fb51eecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:18.833826 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ed210987-7dcf-4633-91a7-4d52fb51eecb None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:18.835008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ed210987-7dcf-4633-91a7-4d52fb51eecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:18.890094 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:18.931969 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 543/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:19.220261 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8f5ad-36bc-448e-b7c6-dd3d6f3eb927 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:19.222351 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-3dc8f5ad-36bc-448e-b7c6-dd3d6f3eb927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:19.365831 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8f5ad-36bc-448e-b7c6-dd3d6f3eb927 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:19.437274 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:19.477579 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c637c-2596-45ed-a6f8-6467c8999b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:19.478174 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c637c-2596-45ed-a6f8-6467c8999b43 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:19.478447 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c637c-2596-45ed-a6f8-6467c8999b43 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:19.478714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c637c-2596-45ed-a6f8-6467c8999b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:19.480332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-247c637c-2596-45ed-a6f8-6467c8999b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:19.578866 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c637c-2596-45ed-a6f8-6467c8999b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:19.580521 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c637c-2596-45ed-a6f8-6467c8999b43 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:19.599405 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 550/1093] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:20.752761 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce7381-ee49-4849-b207-a660fe53a86b None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:20.753341 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce7381-ee49-4849-b207-a660fe53a86b None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:20.753493 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce7381-ee49-4849-b207-a660fe53a86b None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:20.754862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 544/1094] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 11:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:20.761138 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757e103-d1f4-43a1-ad3e-7b170fddae69 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:20.761588 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757e103-d1f4-43a1-ad3e-7b170fddae69 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:20.761696 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757e103-d1f4-43a1-ad3e-7b170fddae69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:20.836993 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1757e103-d1f4-43a1-ad3e-7b170fddae69 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:20.838203 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1757e103-d1f4-43a1-ad3e-7b170fddae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:20.865160 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:20.938767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 551/1095] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:21.089262 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce7381-ee49-4849-b207-a660fe53a86b None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:21.090758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-64ce7381-ee49-4849-b207-a660fe53a86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:21.235025 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce7381-ee49-4849-b207-a660fe53a86b None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:21.275716 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:21.347863 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1d6d1-e1c5-453f-adb1-d34041920155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:21.348375 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d6d1-e1c5-453f-adb1-d34041920155 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:21.348648 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d6d1-e1c5-453f-adb1-d34041920155 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:21.348914 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1d6d1-e1c5-453f-adb1-d34041920155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:21.350482 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-fff1d6d1-e1c5-453f-adb1-d34041920155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:21.438309 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1d6d1-e1c5-453f-adb1-d34041920155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:21.439925 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1d6d1-e1c5-453f-adb1-d34041920155 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:21.458567 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 545/1096] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:22.609694 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4521-7dd4-4d2d-9630-1b930cf8bde1 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:22.610255 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4521-7dd4-4d2d-9630-1b930cf8bde1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:22.610255 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4521-7dd4-4d2d-9630-1b930cf8bde1 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:22.611601 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 552/1097] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 11:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:22.618758 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b9d8-83d3-4ec9-ab44-b25f900dfd6c None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:22.619212 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b9d8-83d3-4ec9-ab44-b25f900dfd6c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:22.619355 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795b9d8-83d3-4ec9-ab44-b25f900dfd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:22.673662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:22.695685 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-d795b9d8-83d3-4ec9-ab44-b25f900dfd6c None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:22.696890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d795b9d8-83d3-4ec9-ab44-b25f900dfd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:22.791473 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 546/1098] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 11:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:22.943624 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4521-7dd4-4d2d-9630-1b930cf8bde1 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:22.945094 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8e1c4521-7dd4-4d2d-9630-1b930cf8bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:23.089919 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4521-7dd4-4d2d-9630-1b930cf8bde1 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:23.102727 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:23.202613 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb38f6-4627-4a5c-b1d4-cd445534303a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:23.203227 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb38f6-4627-4a5c-b1d4-cd445534303a service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:23.203979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb38f6-4627-4a5c-b1d4-cd445534303a service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:23.204254 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb38f6-4627-4a5c-b1d4-cd445534303a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:23.206767 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c1fb38f6-4627-4a5c-b1d4-cd445534303a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:23.300884 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb38f6-4627-4a5c-b1d4-cd445534303a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:23.302374 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb38f6-4627-4a5c-b1d4-cd445534303a service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:23.320252 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 553/1099] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:24.442170 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b79ea-a602-4b84-ba87-b614be04c172 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:24.442731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b79ea-a602-4b84-ba87-b614be04c172 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:24.442731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b79ea-a602-4b84-ba87-b614be04c172 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:24.444180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 547/1100] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 11:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:24.450565 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a51b9-606e-439a-884b-53b1ff4bbc70 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:24.451018 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a51b9-606e-439a-884b-53b1ff4bbc70 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:24.451123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a51b9-606e-439a-884b-53b1ff4bbc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:24.470822 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:24.527124 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-f09a51b9-606e-439a-884b-53b1ff4bbc70 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:24.528347 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f09a51b9-606e-439a-884b-53b1ff4bbc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:24.623735 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 554/1101] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 11:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:24.774205 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b79ea-a602-4b84-ba87-b614be04c172 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:24.775673 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-257b79ea-a602-4b84-ba87-b614be04c172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:24.886977 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:24.922852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b79ea-a602-4b84-ba87-b614be04c172 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:25.036238 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e32cc-ea34-435d-9192-7acc575bf361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:25.036755 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e32cc-ea34-435d-9192-7acc575bf361 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:25.037033 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e32cc-ea34-435d-9192-7acc575bf361 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:25.037302 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e32cc-ea34-435d-9192-7acc575bf361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:25.038885 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d44e32cc-ea34-435d-9192-7acc575bf361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:25.114393 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:25.128782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e32cc-ea34-435d-9192-7acc575bf361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:25.130574 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e32cc-ea34-435d-9192-7acc575bf361 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:25.148804 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 548/1102] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:26.273242 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ad5c-a234-4f4a-ad45-4f9b61cdc9a9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:26.273842 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ad5c-a234-4f4a-ad45-4f9b61cdc9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:26.273842 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ad5c-a234-4f4a-ad45-4f9b61cdc9a9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:26.275113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 555/1103] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 11:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:26.281408 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc14447-dd9a-45e5-9885-90ec5a9539ff None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:26.281829 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc14447-dd9a-45e5-9885-90ec5a9539ff None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:26.281952 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc14447-dd9a-45e5-9885-90ec5a9539ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:26.358604 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ebc14447-dd9a-45e5-9885-90ec5a9539ff None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:26.359830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ebc14447-dd9a-45e5-9885-90ec5a9539ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:26.455926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 549/1104] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 11:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:26.607178 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27ad5c-a234-4f4a-ad45-4f9b61cdc9a9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:26.608702 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-af27ad5c-a234-4f4a-ad45-4f9b61cdc9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:26.692745 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:26.754180 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27ad5c-a234-4f4a-ad45-4f9b61cdc9a9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:26.867225 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efe86b-b4f4-42a2-8542-95e23e52c03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:26.867777 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe86b-b4f4-42a2-8542-95e23e52c03a service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:26.868049 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe86b-b4f4-42a2-8542-95e23e52c03a service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:26.868313 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe86b-b4f4-42a2-8542-95e23e52c03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:26.869893 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-67efe86b-b4f4-42a2-8542-95e23e52c03a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:26.918926 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:26.959740 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efe86b-b4f4-42a2-8542-95e23e52c03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:26.961311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efe86b-b4f4-42a2-8542-95e23e52c03a service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:26.978661 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 556/1105] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:28.029120 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326644-3356-4500-84e2-eaea907c47b1 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:28.029776 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326644-3356-4500-84e2-eaea907c47b1 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:28.029776 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326644-3356-4500-84e2-eaea907c47b1 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:28.030983 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 550/1106] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 11:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:28.037753 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eea2b-2ce6-495f-a63d-5d75b567602c None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:28.038180 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eea2b-2ce6-495f-a63d-5d75b567602c None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:28.038290 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595eea2b-2ce6-495f-a63d-5d75b567602c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:28.113123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-595eea2b-2ce6-495f-a63d-5d75b567602c None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:28.114323 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-595eea2b-2ce6-495f-a63d-5d75b567602c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:28.208900 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 557/1107] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 11:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:28.360847 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee326644-3356-4500-84e2-eaea907c47b1 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:28.362815 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ee326644-3356-4500-84e2-eaea907c47b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:28.411771 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:28.507955 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee326644-3356-4500-84e2-eaea907c47b1 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:28.619584 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4642a2-de84-4c26-a5fc-155d556029a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:28.620183 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4642a2-de84-4c26-a5fc-155d556029a2 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:28.620463 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4642a2-de84-4c26-a5fc-155d556029a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:28.620724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4642a2-de84-4c26-a5fc-155d556029a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:28.622293 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8b4642a2-de84-4c26-a5fc-155d556029a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:28.630086 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:28.711662 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4642a2-de84-4c26-a5fc-155d556029a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:28.713164 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4642a2-de84-4c26-a5fc-155d556029a2 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:28.731865 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 551/1108] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:29.788974 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e564-a02f-4b1b-8d46-9c8a10f8b06a None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:29.789548 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e564-a02f-4b1b-8d46-9c8a10f8b06a None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:29.789548 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e564-a02f-4b1b-8d46-9c8a10f8b06a None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:29.790842 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 558/1109] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 11:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 18 11:34:29.796893 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4fcc-3194-4a40-ab0f-9f8d572a54c4 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:29.797315 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4fcc-3194-4a40-ab0f-9f8d572a54c4 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:29.797443 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4fcc-3194-4a40-ab0f-9f8d572a54c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:29.873261 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-ac2a4fcc-3194-4a40-ab0f-9f8d572a54c4 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:29.874452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ac2a4fcc-3194-4a40-ab0f-9f8d572a54c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:29.940985 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:29.970556 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 552/1110] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 11:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:30.122503 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671e564-a02f-4b1b-8d46-9c8a10f8b06a None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:30.124019 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1671e564-a02f-4b1b-8d46-9c8a10f8b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:30.142538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:30.270709 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671e564-a02f-4b1b-8d46-9c8a10f8b06a None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:30.358618 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:30.385168 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82a73a-9e57-465f-bc50-d62fe4b29f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:30.385694 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a73a-9e57-465f-bc50-d62fe4b29f89 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:30.385966 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a73a-9e57-465f-bc50-d62fe4b29f89 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:30.386230 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a73a-9e57-465f-bc50-d62fe4b29f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:30.387860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-7e82a73a-9e57-465f-bc50-d62fe4b29f89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:30.476027 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82a73a-9e57-465f-bc50-d62fe4b29f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:30.477596 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82a73a-9e57-465f-bc50-d62fe4b29f89 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:30.495881 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 559/1111] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:31.561904 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ab1db-8f1b-452a-9663-30d80a572bd3 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:31.562475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ab1db-8f1b-452a-9663-30d80a572bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:31.562475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ab1db-8f1b-452a-9663-30d80a572bd3 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:31.563810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 553/1112] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 11:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:31.570540 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bd0cb-62bf-46ff-9577-75c528e2d45b None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:31.571001 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bd0cb-62bf-46ff-9577-75c528e2d45b None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:31.571129 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bd0cb-62bf-46ff-9577-75c528e2d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:31.648864 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-b92bd0cb-62bf-46ff-9577-75c528e2d45b None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:31.650058 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-b92bd0cb-62bf-46ff-9577-75c528e2d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:31.690847 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:31.744953 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 560/1113] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 11:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:31.894972 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ab1db-8f1b-452a-9663-30d80a572bd3 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:31.896503 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-525ab1db-8f1b-452a-9663-30d80a572bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:32.039408 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ab1db-8f1b-452a-9663-30d80a572bd3 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:32.093799 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:32.152108 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc475f-8746-4df2-8018-1e88e451557e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:32.152712 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc475f-8746-4df2-8018-1e88e451557e service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:32.152988 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc475f-8746-4df2-8018-1e88e451557e service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:32.153258 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc475f-8746-4df2-8018-1e88e451557e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:32.154835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-a2bc475f-8746-4df2-8018-1e88e451557e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:32.246586 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc475f-8746-4df2-8018-1e88e451557e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:32.248202 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc475f-8746-4df2-8018-1e88e451557e service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:32.265954 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 554/1114] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:33.314970 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096a218-f5c6-4d3e-a940-5cc0c47fda15 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:33.315682 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096a218-f5c6-4d3e-a940-5cc0c47fda15 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:33.315682 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096a218-f5c6-4d3e-a940-5cc0c47fda15 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:33.316991 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 561/1115] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 18 11:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:33.323270 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c424c-853d-4619-b77c-3561ea33fc2a None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:33.323707 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c424c-853d-4619-b77c-3561ea33fc2a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:33.323819 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c424c-853d-4619-b77c-3561ea33fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:33.402221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-f15c424c-853d-4619-b77c-3561ea33fc2a None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:33.403455 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f15c424c-853d-4619-b77c-3561ea33fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:33.405568 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:33.502285 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 555/1116] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 18 11:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:33.652729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096a218-f5c6-4d3e-a940-5cc0c47fda15 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:33.654211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0096a218-f5c6-4d3e-a940-5cc0c47fda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:33.800443 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096a218-f5c6-4d3e-a940-5cc0c47fda15 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:33.827798 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:33.914112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ebf99-355e-454f-81d9-6751ead420a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:33.914635 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ebf99-355e-454f-81d9-6751ead420a6 service nova] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:33.914912 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ebf99-355e-454f-81d9-6751ead420a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:33.915183 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ebf99-355e-454f-81d9-6751ead420a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:33.916796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-a82ebf99-355e-454f-81d9-6751ead420a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:34.005867 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ebf99-355e-454f-81d9-6751ead420a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:34.007490 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ebf99-355e-454f-81d9-6751ead420a6 service nova] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:34.025178 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 562/1117] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:36.109095 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c503b9d-3f23-4842-8b01-437645a44e18 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:36.109636 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c503b9d-3f23-4842-8b01-437645a44e18 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:36.109636 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c503b9d-3f23-4842-8b01-437645a44e18 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:36.110964 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 556/1118] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:36.116823 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983573e4-bdec-406b-af8a-444b5cf130b9 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:36.117488 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983573e4-bdec-406b-af8a-444b5cf130b9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:36.117743 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983573e4-bdec-406b-af8a-444b5cf130b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:36.159156 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:36.185093 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-983573e4-bdec-406b-af8a-444b5cf130b9 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:36.186332 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-983573e4-bdec-406b-af8a-444b5cf130b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:36.281369 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 563/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:36.567403 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c503b9d-3f23-4842-8b01-437645a44e18 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:36.568926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-7c503b9d-3f23-4842-8b01-437645a44e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:36.670535 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c503b9d-3f23-4842-8b01-437645a44e18 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:36.703381 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:36.744870 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda2192-cf0b-4da3-9da4-66ad1c7df795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:36.745464 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2192-cf0b-4da3-9da4-66ad1c7df795 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:36.745739 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2192-cf0b-4da3-9da4-66ad1c7df795 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:36.746008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2192-cf0b-4da3-9da4-66ad1c7df795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:36.747696 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1eda2192-cf0b-4da3-9da4-66ad1c7df795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:36.853891 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda2192-cf0b-4da3-9da4-66ad1c7df795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:36.855365 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda2192-cf0b-4da3-9da4-66ad1c7df795 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:36.873808 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 557/1120] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:39.172200 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839b6be-d570-4c48-aaec-3990320849d4 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:39.172766 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839b6be-d570-4c48-aaec-3990320849d4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:39.172766 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839b6be-d570-4c48-aaec-3990320849d4 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:39.174078 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 564/1121] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:39.179873 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402911a2-70dd-489b-ba03-6d6a635ad5e0 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:39.180273 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402911a2-70dd-489b-ba03-6d6a635ad5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:39.180444 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402911a2-70dd-489b-ba03-6d6a635ad5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:39.245612 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-402911a2-70dd-489b-ba03-6d6a635ad5e0 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:39.246830 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-402911a2-70dd-489b-ba03-6d6a635ad5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:39.259569 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:39.342498 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 558/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:39.628581 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839b6be-d570-4c48-aaec-3990320849d4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:39.630331 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9839b6be-d570-4c48-aaec-3990320849d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:39.739525 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839b6be-d570-4c48-aaec-3990320849d4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:39.752498 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:39.814426 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e719c-6432-4ed1-9328-877b813f0919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:39.815017 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e719c-6432-4ed1-9328-877b813f0919 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:39.815311 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e719c-6432-4ed1-9328-877b813f0919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:39.816142 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e719c-6432-4ed1-9328-877b813f0919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:39.817849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-472e719c-6432-4ed1-9328-877b813f0919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:39.926395 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e719c-6432-4ed1-9328-877b813f0919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:39.927792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e719c-6432-4ed1-9328-877b813f0919 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:39.946187 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 565/1123] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:42.400822 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505718ae-85dd-4603-bd2a-d55637ce8b54 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:42.401352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505718ae-85dd-4603-bd2a-d55637ce8b54 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:42.401352 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505718ae-85dd-4603-bd2a-d55637ce8b54 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:42.402701 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 559/1124] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:42.408199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57faf34-906f-4fe6-8ac5-8ac8ae17523d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:42.408584 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57faf34-906f-4fe6-8ac5-8ac8ae17523d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:42.408744 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57faf34-906f-4fe6-8ac5-8ac8ae17523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:42.457399 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:42.475636 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-d57faf34-906f-4fe6-8ac5-8ac8ae17523d None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:42.476826 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-d57faf34-906f-4fe6-8ac5-8ac8ae17523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:42.573033 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 566/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:42.862128 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505718ae-85dd-4603-bd2a-d55637ce8b54 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:42.864565 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-505718ae-85dd-4603-bd2a-d55637ce8b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:42.966670 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505718ae-85dd-4603-bd2a-d55637ce8b54 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:43.006895 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:43.040925 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c3598-aad1-4492-8d88-145e537bb019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:43.041527 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3598-aad1-4492-8d88-145e537bb019 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:43.041803 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3598-aad1-4492-8d88-145e537bb019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:43.042073 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c3598-aad1-4492-8d88-145e537bb019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:43.043689 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-112c3598-aad1-4492-8d88-145e537bb019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:43.150182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c3598-aad1-4492-8d88-145e537bb019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:43.151641 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c3598-aad1-4492-8d88-145e537bb019 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:43.168923 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 560/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:45.453906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f88fa-25dc-4700-8672-07d0644567d5 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:45.454487 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f88fa-25dc-4700-8672-07d0644567d5 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:45.454487 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f88fa-25dc-4700-8672-07d0644567d5 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:45.456761 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 567/1127] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:45.462184 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750cd1d-46ee-4d50-8a41-cbe0e2845246 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:45.462616 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750cd1d-46ee-4d50-8a41-cbe0e2845246 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:45.462726 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750cd1d-46ee-4d50-8a41-cbe0e2845246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:45.529221 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-6750cd1d-46ee-4d50-8a41-cbe0e2845246 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:45.530387 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6750cd1d-46ee-4d50-8a41-cbe0e2845246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:45.551569 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:45.629177 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 561/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:45.914319 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f88fa-25dc-4700-8672-07d0644567d5 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:45.915861 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fb6f88fa-25dc-4700-8672-07d0644567d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:46.017848 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f88fa-25dc-4700-8672-07d0644567d5 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:46.038880 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:46.093714 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a5b96-6c23-47cb-8a8f-db59a12f48b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:46.094235 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5b96-6c23-47cb-8a8f-db59a12f48b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:46.094511 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5b96-6c23-47cb-8a8f-db59a12f48b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:46.094782 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a5b96-6c23-47cb-8a8f-db59a12f48b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:46.096396 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9d6a5b96-6c23-47cb-8a8f-db59a12f48b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:46.205249 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a5b96-6c23-47cb-8a8f-db59a12f48b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:46.207102 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a5b96-6c23-47cb-8a8f-db59a12f48b9 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:46.226583 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 568/1129] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:48.547814 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814df7e-c05f-48b6-898a-6cee6147d862 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:48.548353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814df7e-c05f-48b6-898a-6cee6147d862 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:48.548353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814df7e-c05f-48b6-898a-6cee6147d862 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:48.549693 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 562/1130] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:48.555123 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827512c5-9cf5-4f3b-b9ac-ce533f7e4236 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:48.555594 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827512c5-9cf5-4f3b-b9ac-ce533f7e4236 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:48.555733 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827512c5-9cf5-4f3b-b9ac-ce533f7e4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:48.620333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:48.623529 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-827512c5-9cf5-4f3b-b9ac-ce533f7e4236 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:48.625264 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-827512c5-9cf5-4f3b-b9ac-ce533f7e4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:48.719052 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 569/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:49.004913 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814df7e-c05f-48b6-898a-6cee6147d862 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:49.006452 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-9814df7e-c05f-48b6-898a-6cee6147d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:49.108392 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814df7e-c05f-48b6-898a-6cee6147d862 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:49.157061 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:49.181170 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b565cd-3dab-49a6-b473-7d3841742357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:49.181772 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b565cd-3dab-49a6-b473-7d3841742357 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:49.182047 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b565cd-3dab-49a6-b473-7d3841742357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:49.182315 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b565cd-3dab-49a6-b473-7d3841742357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:49.183917 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-39b565cd-3dab-49a6-b473-7d3841742357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:49.290947 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b565cd-3dab-49a6-b473-7d3841742357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:49.292435 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b565cd-3dab-49a6-b473-7d3841742357 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:49.310683 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 563/1132] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:51.559156 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d324b0-e695-494e-8be9-e7adc227d9be None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:51.559732 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d324b0-e695-494e-8be9-e7adc227d9be None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:51.559732 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d324b0-e695-494e-8be9-e7adc227d9be None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:51.561076 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 570/1133] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:51.566663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4ae1-4574-4725-b97e-e04b54cc6dc7 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:51.567068 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4ae1-4574-4725-b97e-e04b54cc6dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:51.567239 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d4ae1-4574-4725-b97e-e04b54cc6dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:51.633927 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-2a6d4ae1-4574-4725-b97e-e04b54cc6dc7 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:51.635123 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2a6d4ae1-4574-4725-b97e-e04b54cc6dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:51.664555 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:51.733353 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 564/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:52.025200 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d324b0-e695-494e-8be9-e7adc227d9be None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:52.026774 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-f7d324b0-e695-494e-8be9-e7adc227d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:52.127966 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d324b0-e695-494e-8be9-e7adc227d9be None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:52.157506 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:52.205657 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463e8c-6f12-445e-8460-31a267b31177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:52.206359 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463e8c-6f12-445e-8460-31a267b31177 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:52.206739 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463e8c-6f12-445e-8460-31a267b31177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:52.207009 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463e8c-6f12-445e-8460-31a267b31177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:52.208613 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-47463e8c-6f12-445e-8460-31a267b31177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:52.318530 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463e8c-6f12-445e-8460-31a267b31177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:52.319984 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463e8c-6f12-445e-8460-31a267b31177 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:52.337916 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 571/1135] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:54.545864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4177b-b469-48b8-875f-49e0d3ce38a0 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:54.546400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4177b-b469-48b8-875f-49e0d3ce38a0 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:54.546400 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4177b-b469-48b8-875f-49e0d3ce38a0 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:54.547788 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 565/1136] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:54.553889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988734a-4030-41fa-96a7-ba7e0d7fa401 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:54.554333 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988734a-4030-41fa-96a7-ba7e0d7fa401 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:54.554461 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988734a-4030-41fa-96a7-ba7e0d7fa401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:54.619729 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9988734a-4030-41fa-96a7-ba7e0d7fa401 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:54.620934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9988734a-4030-41fa-96a7-ba7e0d7fa401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:54.629943 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:54.717692 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 572/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:55.006470 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4177b-b469-48b8-875f-49e0d3ce38a0 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:55.008037 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-27a4177b-b469-48b8-875f-49e0d3ce38a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:55.111920 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4177b-b469-48b8-875f-49e0d3ce38a0 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:55.167202 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:55.185114 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7a25d-f5ea-4dfc-a19b-55c6f2415e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:55.185731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a25d-f5ea-4dfc-a19b-55c6f2415e65 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:55.186001 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a25d-f5ea-4dfc-a19b-55c6f2415e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:55.186267 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a25d-f5ea-4dfc-a19b-55c6f2415e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:55.187854 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-76b7a25d-f5ea-4dfc-a19b-55c6f2415e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:55.295310 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7a25d-f5ea-4dfc-a19b-55c6f2415e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:55.296732 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7a25d-f5ea-4dfc-a19b-55c6f2415e65 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:55.316697 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 566/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:34:57.529684 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3929a1-0991-4c17-b00e-e1e4bb3088f9 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:57.530338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3929a1-0991-4c17-b00e-e1e4bb3088f9 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:57.530338 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3929a1-0991-4c17-b00e-e1e4bb3088f9 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:57.531614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 573/1139] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:34:57.537522 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba570e-26d6-49af-bfd9-8d44ee7f0158 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:57.537980 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba570e-26d6-49af-bfd9-8d44ee7f0158 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:57.538089 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba570e-26d6-49af-bfd9-8d44ee7f0158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:57.602537 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-38ba570e-26d6-49af-bfd9-8d44ee7f0158 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:34:57.603774 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-38ba570e-26d6-49af-bfd9-8d44ee7f0158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:57.642189 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:57.701464 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 567/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:34:57.985070 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3929a1-0991-4c17-b00e-e1e4bb3088f9 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:34:57.986592 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-af3929a1-0991-4c17-b00e-e1e4bb3088f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:58.089849 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3929a1-0991-4c17-b00e-e1e4bb3088f9 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:34:58.127436 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:34:58.163702 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ac33-89ce-4d52-a7cc-ce1a889ce279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:34:58.164286 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ac33-89ce-4d52-a7cc-ce1a889ce279 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:34:58.164560 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ac33-89ce-4d52-a7cc-ce1a889ce279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:34:58.164828 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ac33-89ce-4d52-a7cc-ce1a889ce279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:34:58.166390 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-08b1ac33-89ce-4d52-a7cc-ce1a889ce279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:34:58.275571 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1ac33-89ce-4d52-a7cc-ce1a889ce279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:34:58.276980 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1ac33-89ce-4d52-a7cc-ce1a889ce279 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:34:58.294587 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 574/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:00.470188 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be8ffe-8bf1-4bb5-9faa-11a938f02e61 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:00.470752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be8ffe-8bf1-4bb5-9faa-11a938f02e61 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:00.470752 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be8ffe-8bf1-4bb5-9faa-11a938f02e61 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:00.472156 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 568/1142] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:00.477611 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed8b6-48d4-41e4-b987-891f415246c6 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:00.478031 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed8b6-48d4-41e4-b987-891f415246c6 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:00.478154 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ed8b6-48d4-41e4-b987-891f415246c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:00.544383 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-208ed8b6-48d4-41e4-b987-891f415246c6 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:00.545580 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-208ed8b6-48d4-41e4-b987-891f415246c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:00.563687 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:00.641743 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 575/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:00.926284 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be8ffe-8bf1-4bb5-9faa-11a938f02e61 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:00.927822 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-52be8ffe-8bf1-4bb5-9faa-11a938f02e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:01.032198 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be8ffe-8bf1-4bb5-9faa-11a938f02e61 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:01.100073 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:01.107804 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5d1e4-ea2a-4d15-bddf-fe3b2f1a2a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:01.108407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5d1e4-ea2a-4d15-bddf-fe3b2f1a2a59 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:01.108684 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5d1e4-ea2a-4d15-bddf-fe3b2f1a2a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:01.108955 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5d1e4-ea2a-4d15-bddf-fe3b2f1a2a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:01.110562 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-89a5d1e4-ea2a-4d15-bddf-fe3b2f1a2a59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:01.219888 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5d1e4-ea2a-4d15-bddf-fe3b2f1a2a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:01.221311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5d1e4-ea2a-4d15-bddf-fe3b2f1a2a59 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:01.240220 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 569/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:03.442460 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2930-741f-42e2-b8ac-1796c263d852 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:03.443048 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2930-741f-42e2-b8ac-1796c263d852 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:03.443048 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2930-741f-42e2-b8ac-1796c263d852 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:03.444383 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 576/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 18 11:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:03.449673 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b43e7b-ac02-47bc-a884-b57446047b47 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:03.450101 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b43e7b-ac02-47bc-a884-b57446047b47 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:03.450227 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b43e7b-ac02-47bc-a884-b57446047b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:03.515835 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-e1b43e7b-ac02-47bc-a884-b57446047b47 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:03.517027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-e1b43e7b-ac02-47bc-a884-b57446047b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:03.565567 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:03.613527 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 570/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 18 11:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:03.896281 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2930-741f-42e2-b8ac-1796c263d852 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:03.897801 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-0ede2930-741f-42e2-b8ac-1796c263d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:04.000683 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2930-741f-42e2-b8ac-1796c263d852 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:04.048236 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:04.074330 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97009dde-4d63-4d83-b284-5fbd38838173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:04.074922 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009dde-4d63-4d83-b284-5fbd38838173 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:04.075194 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009dde-4d63-4d83-b284-5fbd38838173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:04.075554 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009dde-4d63-4d83-b284-5fbd38838173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:04.077163 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-97009dde-4d63-4d83-b284-5fbd38838173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:04.185846 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97009dde-4d63-4d83-b284-5fbd38838173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:04.187284 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97009dde-4d63-4d83-b284-5fbd38838173 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:04.205321 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 577/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:13.611695 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=22 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:14.202934 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=66 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:24.299477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94cf3-7da8-4989-bbe1-359e4c092e9a None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:24.300663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94cf3-7da8-4989-bbe1-359e4c092e9a None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:24.300663 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94cf3-7da8-4989-bbe1-359e4c092e9a None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:24.302035 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 571/1148] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:24.307525 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0ca2-e38d-4d62-a13a-8edda5024fbc None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:24.307939 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0ca2-e38d-4d62-a13a-8edda5024fbc None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:24.308066 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0ca2-e38d-4d62-a13a-8edda5024fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:24.373283 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-ef5c0ca2-e38d-4d62-a13a-8edda5024fbc None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:24.374462 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ef5c0ca2-e38d-4d62-a13a-8edda5024fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:24.468754 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 578/1149] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:24.767721 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76de2-58cd-4e97-924f-4d2653cf5d9c None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:24.768008 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76de2-58cd-4e97-924f-4d2653cf5d9c None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:24.768287 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c76de2-58cd-4e97-924f-4d2653cf5d9c None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:24.770423 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 572/1150] 10.222.0.18 () {54 vars in 962 bytes} [Tue Oct 18 11:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:24.775326 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0adb-9ba6-470c-a425-61709791f29d None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:24.775611 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0adb-9ba6-470c-a425-61709791f29d None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:24.775885 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0adb-9ba6-470c-a425-61709791f29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:24.853240 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9f6f0adb-9ba6-470c-a425-61709791f29d None None] MFA Rules not processed for user `f7ca69834de848d1a3cbbeb63c6a0645`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:24.854434 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9f6f0adb-9ba6-470c-a425-61709791f29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:24.875037 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:24.931003 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 579/1151] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Oct 18 11:35:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:24.938687 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c76de2-58cd-4e97-924f-4d2653cf5d9c None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:24.940206 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-f5c76de2-58cd-4e97-924f-4d2653cf5d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:25.045126 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c76de2-58cd-4e97-924f-4d2653cf5d9c None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:25.120136 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9eb41a-c4f3-4217-a607-c6ecdee0aac6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ca69834de848d1a3cbbeb63c6a0645', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:25.120731 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9eb41a-c4f3-4217-a607-c6ecdee0aac6 service glance] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:25.121005 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9eb41a-c4f3-4217-a607-c6ecdee0aac6 service glance] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:25.121275 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9eb41a-c4f3-4217-a607-c6ecdee0aac6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:25.122843 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-0a9eb41a-c4f3-4217-a607-c6ecdee0aac6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:25.178710 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:25.234351 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9eb41a-c4f3-4217-a607-c6ecdee0aac6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:25.235820 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9eb41a-c4f3-4217-a607-c6ecdee0aac6 service glance] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:25.255585 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 573/1152] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:27.505569 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03b483-3e40-40d9-93e8-b98d6f45a9b4 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:27.506140 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03b483-3e40-40d9-93e8-b98d6f45a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:27.506140 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03b483-3e40-40d9-93e8-b98d6f45a9b4 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:27.507503 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 580/1153] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:27.512747 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccfc75-1b9b-4d06-be40-cad6adc98efa None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:27.513175 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccfc75-1b9b-4d06-be40-cad6adc98efa None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:27.513278 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ccfc75-1b9b-4d06-be40-cad6adc98efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:27.578791 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-84ccfc75-1b9b-4d06-be40-cad6adc98efa None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:27.580057 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-84ccfc75-1b9b-4d06-be40-cad6adc98efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:27.676742 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 574/1154] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:27.952115 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03b483-3e40-40d9-93e8-b98d6f45a9b4 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:27.953614 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1f03b483-3e40-40d9-93e8-b98d6f45a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:28.078316 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03b483-3e40-40d9-93e8-b98d6f45a9b4 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:28.128980 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:28.173389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4e310-50da-4d14-b648-0a1a805dc59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:28.173981 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e310-50da-4d14-b648-0a1a805dc59f admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:28.174251 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e310-50da-4d14-b648-0a1a805dc59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:28.174518 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4e310-50da-4d14-b648-0a1a805dc59f admin admin] PATH_INFO: `/v3/projects` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:28.175831 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4e310-50da-4d14-b648-0a1a805dc59f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:28.176915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-11c4e310-50da-4d14-b648-0a1a805dc59f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:35:28.176915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: warnings.warn(msg) Oct 18 11:35:28.176915 dv-cinder-815582-17-smb devstack@keystone.service[81703]: Oct 18 11:35:28.178053 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4e310-50da-4d14-b648-0a1a805dc59f admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:28.197268 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 581/1155] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Oct 18 11:35:27 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:35:30.354890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fc2d-71a1-42d8-bbe8-3dfdac5410db None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:30.355530 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fc2d-71a1-42d8-bbe8-3dfdac5410db None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:30.355530 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fc2d-71a1-42d8-bbe8-3dfdac5410db None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:30.356800 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 575/1156] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:30.362062 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14007e-6f77-44bf-9da4-8d6bf298984e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:30.362499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14007e-6f77-44bf-9da4-8d6bf298984e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:30.363290 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14007e-6f77-44bf-9da4-8d6bf298984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:30.429807 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-4e14007e-6f77-44bf-9da4-8d6bf298984e None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:30.431040 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-4e14007e-6f77-44bf-9da4-8d6bf298984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:30.527475 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 582/1157] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:30.836040 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672fc2d-71a1-42d8-bbe8-3dfdac5410db None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:30.837580 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-c672fc2d-71a1-42d8-bbe8-3dfdac5410db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:30.848154 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:30.986970 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672fc2d-71a1-42d8-bbe8-3dfdac5410db None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:31.067117 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:31.103621 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322b0d7-abda-45de-9dd6-66394dec0e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a286777ff794c7a973a07881c195de1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:31.104225 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322b0d7-abda-45de-9dd6-66394dec0e52 service nova] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:31.104495 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322b0d7-abda-45de-9dd6-66394dec0e52 service nova] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:31.104761 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322b0d7-abda-45de-9dd6-66394dec0e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:31.106330 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1322b0d7-abda-45de-9dd6-66394dec0e52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:31.199304 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322b0d7-abda-45de-9dd6-66394dec0e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:31.200878 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322b0d7-abda-45de-9dd6-66394dec0e52 service nova] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:31.218831 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 576/1158] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:33.556423 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0db9-0d07-4311-a9b0-2cb22d772b65 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:33.556999 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0db9-0d07-4311-a9b0-2cb22d772b65 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:33.557114 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef0db9-0d07-4311-a9b0-2cb22d772b65 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:33.558499 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 583/1159] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:33.563978 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf5ee-18aa-4577-8a87-e9b69c45c4dd None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:33.564375 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf5ee-18aa-4577-8a87-e9b69c45c4dd None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:33.564512 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf5ee-18aa-4577-8a87-e9b69c45c4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:33.630997 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-bdecf5ee-18aa-4577-8a87-e9b69c45c4dd None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:33.632151 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-bdecf5ee-18aa-4577-8a87-e9b69c45c4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:33.677521 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:33.727664 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 577/1160] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:34.016896 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef0db9-0d07-4311-a9b0-2cb22d772b65 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:34.018435 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-eaef0db9-0d07-4311-a9b0-2cb22d772b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:34.043667 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:34.123199 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef0db9-0d07-4311-a9b0-2cb22d772b65 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:34.196959 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd443383-7968-4779-8e6e-5e4e54ad0ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:34.197552 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd443383-7968-4779-8e6e-5e4e54ad0ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:34.197823 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd443383-7968-4779-8e6e-5e4e54ad0ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:34.198085 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd443383-7968-4779-8e6e-5e4e54ad0ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:34.199667 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-bd443383-7968-4779-8e6e-5e4e54ad0ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:34.274906 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:34.309515 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd443383-7968-4779-8e6e-5e4e54ad0ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:34.310928 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd443383-7968-4779-8e6e-5e4e54ad0ae3 service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:34.328402 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 584/1161] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:36.542618 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34722-5e02-47e4-82d8-aa872364501e None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:36.543182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34722-5e02-47e4-82d8-aa872364501e None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:36.543182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca34722-5e02-47e4-82d8-aa872364501e None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:36.544536 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 578/1162] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:36.549787 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215d2f-265f-4ab0-a790-148a389e4789 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:36.550888 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215d2f-265f-4ab0-a790-148a389e4789 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:36.550983 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215d2f-265f-4ab0-a790-148a389e4789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:36.617722 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-9a215d2f-265f-4ab0-a790-148a389e4789 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:36.618979 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-9a215d2f-265f-4ab0-a790-148a389e4789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:36.716112 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 585/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:37.013193 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca34722-5e02-47e4-82d8-aa872364501e None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:37.014713 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-2ca34722-5e02-47e4-82d8-aa872364501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:37.120553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca34722-5e02-47e4-82d8-aa872364501e None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:37.191090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:37.192686 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd64641-b80a-4509-8c75-7b2695cf061f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:37.193365 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd64641-b80a-4509-8c75-7b2695cf061f service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:37.193864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd64641-b80a-4509-8c75-7b2695cf061f service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:37.194155 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd64641-b80a-4509-8c75-7b2695cf061f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:37.196131 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ddd64641-b80a-4509-8c75-7b2695cf061f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:37.304134 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd64641-b80a-4509-8c75-7b2695cf061f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:37.305553 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd64641-b80a-4509-8c75-7b2695cf061f service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:37.323185 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 579/1164] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:39.616734 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e0b2-a705-4340-a25b-a6e23565b6e2 None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:39.617296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e0b2-a705-4340-a25b-a6e23565b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:39.617296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5e0b2-a705-4340-a25b-a6e23565b6e2 None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:39.618871 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 586/1165] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:39.624282 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eae02-df98-43af-8f0a-fb9b8fe1a722 None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:39.624676 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eae02-df98-43af-8f0a-fb9b8fe1a722 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:39.624852 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eae02-df98-43af-8f0a-fb9b8fe1a722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:39.689657 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-8e4eae02-df98-43af-8f0a-fb9b8fe1a722 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:39.690853 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-8e4eae02-df98-43af-8f0a-fb9b8fe1a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:39.744604 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:39.788226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 580/1166] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:40.086061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5e0b2-a705-4340-a25b-a6e23565b6e2 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:40.087655 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-edb5e0b2-a705-4340-a25b-a6e23565b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:40.123517 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:40.190431 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5e0b2-a705-4340-a25b-a6e23565b6e2 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:40.265171 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f624820-ae0b-4e0d-9d47-4ed8ff3ba8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:40.265792 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624820-ae0b-4e0d-9d47-4ed8ff3ba8fe service neutron] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:40.266061 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624820-ae0b-4e0d-9d47-4ed8ff3ba8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:40.266323 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f624820-ae0b-4e0d-9d47-4ed8ff3ba8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:40.267967 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-8f624820-ae0b-4e0d-9d47-4ed8ff3ba8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:40.347947 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:40.377422 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f624820-ae0b-4e0d-9d47-4ed8ff3ba8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:40.379538 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f624820-ae0b-4e0d-9d47-4ed8ff3ba8fe service neutron] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:40.397785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 587/1167] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:42.745669 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fa27-1583-4476-a3bd-fac200ff234d None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:42.746182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fa27-1583-4476-a3bd-fac200ff234d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:42.746182 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364fa27-1583-4476-a3bd-fac200ff234d None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:42.747559 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 581/1168] 10.222.0.18 () {54 vars in 927 bytes} [Tue Oct 18 11:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:35:42.752750 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d9a64-dd5d-459c-adfc-a28d0a178db8 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:42.753211 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d9a64-dd5d-459c-adfc-a28d0a178db8 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:42.753343 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d9a64-dd5d-459c-adfc-a28d0a178db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:42.818315 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-5f5d9a64-dd5d-459c-adfc-a28d0a178db8 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:35:42.819548 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-5f5d9a64-dd5d-459c-adfc-a28d0a178db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:42.915889 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 588/1169] 10.222.0.18 () {58 vars in 1024 bytes} [Tue Oct 18 11:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:35:43.205328 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fa27-1583-4476-a3bd-fac200ff234d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:35:43.207759 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-d364fa27-1583-4476-a3bd-fac200ff234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:43.309424 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364fa27-1583-4476-a3bd-fac200ff234d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:35:43.383656 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167c875-b18b-45e9-b5c2-139dbdc3f6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:35:43.384246 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167c875-b18b-45e9-b5c2-139dbdc3f6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:35:43.384532 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167c875-b18b-45e9-b5c2-139dbdc3f6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:35:43.384796 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167c875-b18b-45e9-b5c2-139dbdc3f6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:35:43.386347 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-6167c875-b18b-45e9-b5c2-139dbdc3f6f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:35:43.394968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:43.494764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167c875-b18b-45e9-b5c2-139dbdc3f6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:35:43.496234 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167c875-b18b-45e9-b5c2-139dbdc3f6f4 service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:35:43.514862 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 582/1170] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:35:52.914372 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=82 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:35:53.512612 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=50 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:56.764873 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0521e-4277-441e-8246-b8050487c6a7 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:56.765471 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0521e-4277-441e-8246-b8050487c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:56.765471 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0521e-4277-441e-8246-b8050487c6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:56.841439 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-1bd0521e-4277-441e-8246-b8050487c6a7 None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:36:56.842639 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1bd0521e-4277-441e-8246-b8050487c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:56.938098 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 589/1171] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 18 11:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:36:56.946140 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8cc53-0ea6-4606-acda-c824132a045d None None] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:56.946644 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8cc53-0ea6-4606-acda-c824132a045d None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:56.946746 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8cc53-0ea6-4606-acda-c824132a045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:57.022046 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.auth.core [None req-3ce8cc53-0ea6-4606-acda-c824132a045d None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81702) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:36:57.023151 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-3ce8cc53-0ea6-4606-acda-c824132a045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:57.117180 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 583/1172] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 18 11:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:36:57.122066 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0521e-4277-441e-8246-b8050487c6a7 None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:57.123278 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-1bd0521e-4277-441e-8246-b8050487c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:57.136483 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0521e-4277-441e-8246-b8050487c6a7 None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:57.198060 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:57.231134 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:57.231757 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:57.232030 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:57.232296 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] PATH_INFO: `/v3/domains` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:57.232921 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81703) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 18 11:36:57.233214 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:57.234196 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:36:57.234196 dv-cinder-815582-17-smb devstack@keystone.service[81703]: warnings.warn(msg) Oct 18 11:36:57.234196 dv-cinder-815582-17-smb devstack@keystone.service[81703]: Oct 18 11:36:57.235063 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:57.247090 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 590/1173] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Oct 18 11:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 18 11:36:57.257479 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8cc53-0ea6-4606-acda-c824132a045d None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:57.266423 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8cc53-0ea6-4606-acda-c824132a045d None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:57.327611 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:57.361152 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:57.361741 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] REQUEST_METHOD: `POST` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:57.362009 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:57.362272 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:57.363226 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:57.364412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:36:57.364412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: warnings.warn(msg) Oct 18 11:36:57.364412 dv-cinder-815582-17-smb devstack@keystone.service[81702]: Oct 18 11:36:57.365598 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:57.421890 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 584/1174] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Oct 18 11:36:57 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:36:57.426298 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:57.428370 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:57.461644 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d0e48-3310-4a8a-8f75-d3ec4423ccee admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:57.554860 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:57.555610 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:57.555890 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:57.556162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] PATH_INFO: `/v3/users` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:57.556793 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:57.557785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:36:57.557785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: warnings.warn(msg) Oct 18 11:36:57.557785 dv-cinder-815582-17-smb devstack@keystone.service[81703]: Oct 18 11:36:57.558990 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:57.601878 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 591/1175] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Oct 18 11:36:57 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 18 11:36:57.605773 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:57.607324 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:57.668968 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2295d-d045-4ccd-9de0-d7a9fcabfa03 admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:57.752090 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:57.763426 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:57.764022 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:57.764295 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:57.764564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] PATH_INFO: `/v3/roles` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:57.765192 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:57.766782 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:57.779110 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 585/1176] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 18 11:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:36:57.783074 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:57.784649 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:57.795796 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64200ca3-fdc6-448b-8ee0-939759859374 admin admin] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:57.821103 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:57.892285 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713b075-6f4b-4137-95f4-87dfcea31e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:57.892887 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b075-6f4b-4137-95f4-87dfcea31e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:57.893162 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b075-6f4b-4137-95f4-87dfcea31e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:57.893428 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713b075-6f4b-4137-95f4-87dfcea31e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:57.894254 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713b075-6f4b-4137-95f4-87dfcea31e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:57.895996 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713b075-6f4b-4137-95f4-87dfcea31e01 admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:57.908023 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 592/1177] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Oct 18 11:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 18 11:36:57.912909 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:57.914424 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:57.947607 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a6ae2-2506-49a7-b37b-895d6636173e admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:58.037810 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4dff-51d1-42ed-a27f-a3eaaf0520cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:58.038451 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4dff-51d1-42ed-a27f-a3eaaf0520cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:58.038724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4dff-51d1-42ed-a27f-a3eaaf0520cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:58.039007 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4dff-51d1-42ed-a27f-a3eaaf0520cd admin admin] PATH_INFO: `/v3/projects/130282bdad144bcab091178bbaaa239e/users/27936f9df6344991ad415ba788ae0298/roles/9e0338b743904d8ea8d77f7cea397655` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:58.061604 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef4dff-51d1-42ed-a27f-a3eaaf0520cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=130282bdad144bcab091178bbaaa239e, user_id=27936f9df6344991ad415ba788ae0298, role_id=9e0338b743904d8ea8d77f7cea397655)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:58.064266 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef4dff-51d1-42ed-a27f-a3eaaf0520cd admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:58.088764 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 586/1178] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Oct 18 11:36:57 2022] PUT /identity/v3/projects/130282bdad144bcab091178bbaaa239e/users/27936f9df6344991ad415ba788ae0298/roles/9e0338b743904d8ea8d77f7cea397655 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:36:58.100602 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d250-c4ac-4eb5-ad65-66b0c41af1e1 None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:58.100902 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d250-c4ac-4eb5-ad65-66b0c41af1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:58.101170 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273d250-c4ac-4eb5-ad65-66b0c41af1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:58.157153 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-c273d250-c4ac-4eb5-ad65-66b0c41af1e1 None None] MFA Rules not processed for user `27936f9df6344991ad415ba788ae0298`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:36:58.158252 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-c273d250-c4ac-4eb5-ad65-66b0c41af1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:58.234948 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 593/1179] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 18 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:36:58.249027 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37675358-b460-4401-827f-2e77184b5f65 None None] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:58.249305 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37675358-b460-4401-827f-2e77184b5f65 None None] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:58.249572 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37675358-b460-4401-827f-2e77184b5f65 None None] PATH_INFO: `/` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:58.250905 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 587/1180] 10.222.0.18 () {54 vars in 963 bytes} [Tue Oct 18 11:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:36:58.255793 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa851df8-c07b-47cb-b5a8-e9bd969a0d0e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:58.256079 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa851df8-c07b-47cb-b5a8-e9bd969a0d0e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:58.256382 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa851df8-c07b-47cb-b5a8-e9bd969a0d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:58.287779 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:58.330781 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-fa851df8-c07b-47cb-b5a8-e9bd969a0d0e None None] MFA Rules not processed for user `676b9d7241084e86b41d982484363d24`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:36:58.332719 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-fa851df8-c07b-47cb-b5a8-e9bd969a0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:58.407389 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 594/1181] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Oct 18 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:36:58.415735 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37675358-b460-4401-827f-2e77184b5f65 None None] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:58.417231 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-37675358-b460-4401-827f-2e77184b5f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:58.465958 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:58.520573 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37675358-b460-4401-827f-2e77184b5f65 None None] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:58.593836 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '676b9d7241084e86b41d982484363d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:58.594434 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:58.594705 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:58.594967 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:58.596564 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:58.694733 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:58.696137 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:58.699666 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:58.714268 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 588/1182] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:36:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:36:58.760811 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb99bd-05d7-4cd0-8fd3-d8a3748cbd7e None None] REQUEST_METHOD: `GET` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:58.761109 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb99bd-05d7-4cd0-8fd3-d8a3748cbd7e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:58.761363 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb99bd-05d7-4cd0-8fd3-d8a3748cbd7e None None] PATH_INFO: `/` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:58.762595 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 595/1183] 10.222.0.18 () {52 vars in 830 bytes} [Tue Oct 18 11:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 18 11:36:58.766230 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:58.767475 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:58.865217 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a608d-90fa-4ade-b0a2-876d556a00ed service cinder] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:58.958477 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:58.959088 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:58.959311 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:58.959581 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] PATH_INFO: `/v3/users/27936f9df6344991ad415ba788ae0298` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:58.972507 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] RBAC: Authorizing `identity:delete_user(user_id=27936f9df6344991ad415ba788ae0298)` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:58.973532 dv-cinder-815582-17-smb devstack@keystone.service[81702]: WARNING py.warnings [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:36:58.973532 dv-cinder-815582-17-smb devstack@keystone.service[81702]: warnings.warn(msg) Oct 18 11:36:58.973532 dv-cinder-815582-17-smb devstack@keystone.service[81702]: Oct 18 11:36:58.974750 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:58.984502 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=100 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:59.040926 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27936f9df6344991ad415ba788ae0298'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:36:59.054701 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27936f9df6344991ad415ba788ae0298'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:36:59.055140 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27936f9df6344991ad415ba788ae0298'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:36:59.078198 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27936f9df6344991ad415ba788ae0298'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:36:59.087240 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.notifications [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27936f9df6344991ad415ba788ae0298'} {{(pid=81702) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:36:59.093054 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 589/1184] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Oct 18 11:36:58 2022] DELETE /identity/v3/users/27936f9df6344991ad415ba788ae0298 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:36:59.097572 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9f255-9e15-40c6-8b6b-ad6f3986120e None None] REQUEST_METHOD: `POST` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:59.098136 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9f255-9e15-40c6-8b6b-ad6f3986120e None None] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:59.098308 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9f255-9e15-40c6-8b6b-ad6f3986120e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:59.157124 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.auth.core [None req-49b9f255-9e15-40c6-8b6b-ad6f3986120e None None] MFA Rules not processed for user `abc5671b261f45af8270d5381600d177`. Rule list: `[]` (Enabled: `True`). {{(pid=81703) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 18 11:36:59.158301 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-49b9f255-9e15-40c6-8b6b-ad6f3986120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:59.233312 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=100 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:59.246650 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 596/1185] 10.222.0.18 () {58 vars in 958 bytes} [Tue Oct 18 11:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 18 11:36:59.256724 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] Authenticating user token {{(pid=81702) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:59.257939 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:59.357576 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70d061-b838-4fd4-b7f6-5436299cffed admin admin] Validating token access rules against request {{(pid=81702) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:36:59.411833 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:36:59.432805 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f50e9-a8a9-44ba-bbf7-a83525c61bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2572ace3a9f4b929f38c8d74ee3faa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b526bee144da4b9cbb2deb3d6518b4f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81702) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:36:59.433407 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f50e9-a8a9-44ba-bbf7-a83525c61bdb service neutron] REQUEST_METHOD: `GET` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:36:59.433682 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f50e9-a8a9-44ba-bbf7-a83525c61bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:36:59.433951 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f50e9-a8a9-44ba-bbf7-a83525c61bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81702) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:36:59.435579 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.fernet_utils [None req-ea0f50e9-a8a9-44ba-bbf7-a83525c61bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81702) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:59.542628 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f50e9-a8a9-44ba-bbf7-a83525c61bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:36:59.544466 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f50e9-a8a9-44ba-bbf7-a83525c61bdb service neutron] RBAC: Authorization granted {{(pid=81702) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:36:59.563864 dv-cinder-815582-17-smb devstack@keystone.service[81702]: [pid: 81702|app: 0|req: 590/1186] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Oct 18 11:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 18 11:36:59.915758 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9f255-9e15-40c6-8b6b-ad6f3986120e None None] Authenticating user token {{(pid=81703) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 18 11:36:59.917113 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.fernet_utils [None req-49b9f255-9e15-40c6-8b6b-ad6f3986120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81703) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 18 11:36:59.929024 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9f255-9e15-40c6-8b6b-ad6f3986120e None None] Validating token access rules against request {{(pid=81703) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 18 11:37:00.033527 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc5671b261f45af8270d5381600d177', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdaa8f68f2eb45d98feb8999be80016c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81703) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 18 11:37:00.034156 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 18 11:37:00.034452 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] SCRIPT_NAME: `/identity` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 18 11:37:00.034721 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] PATH_INFO: `/v3/projects/130282bdad144bcab091178bbaaa239e` {{(pid=81703) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 18 11:37:00.044546 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] RBAC: Authorizing `identity:delete_project(project_id=130282bdad144bcab091178bbaaa239e)` {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 18 11:37:00.045611 dv-cinder-815582-17-smb devstack@keystone.service[81703]: WARNING py.warnings [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 18 11:37:00.045611 dv-cinder-815582-17-smb devstack@keystone.service[81703]: warnings.warn(msg) Oct 18 11:37:00.045611 dv-cinder-815582-17-smb devstack@keystone.service[81703]: Oct 18 11:37:00.046730 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] RBAC: Authorization granted {{(pid=81703) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 18 11:37:00.107220 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130282bdad144bcab091178bbaaa239e', 'request_id': 'req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:37:00.113912 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130282bdad144bcab091178bbaaa239e', 'request_id': 'req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:37:00.124017 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130282bdad144bcab091178bbaaa239e', 'request_id': 'req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d'} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:37:00.153479 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] The token cache is being invalidate because project 130282bdad144bcab091178bbaaa239e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81703) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 18 11:37:00.153763 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:37:00.154275 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG keystone.notifications [None req-a0ccd1c6-3371-4ee6-ab6e-ea66971b666d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81703) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 18 11:37:00.155599 dv-cinder-815582-17-smb devstack@keystone.service[81703]: [pid: 81703|app: 0|req: 597/1187] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Oct 18 11:36:59 2022] DELETE /identity/v3/projects/130282bdad144bcab091178bbaaa239e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 18 11:37:09.561581 dv-cinder-815582-17-smb devstack@keystone.service[81702]: DEBUG dbcounter [-] [81702] Writing DB stats keystone:SELECT=62 {{(pid=81702) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 18 11:37:10.151430 dv-cinder-815582-17-smb devstack@keystone.service[81703]: DEBUG dbcounter [-] [81703] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81703) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}